Aug 17 19:49:13 user nova-compute[72815]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 17 19:49:16 user nova-compute[72815]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72815) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 19:49:16 user nova-compute[72815]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72815) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 19:49:16 user nova-compute[72815]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72815) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 19:49:16 user nova-compute[72815]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 17 19:49:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:49:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:49:17 user nova-compute[72815]: INFO nova.virt.driver [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 17 19:49:17 user nova-compute[72815]: INFO nova.compute.provider_config [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] Acquiring lock "singleton_lock" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] Acquired lock "singleton_lock" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] Releasing lock "singleton_lock" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] Full set of CONF: {{(pid=72815) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ******************************************************************************** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] Configuration options gathered from: {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ================================================================================ {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] allow_resize_to_same_host      = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] arq_binding_timeout            = 300 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] backdoor_port                  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] backdoor_socket                = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] block_device_allocate_retries  = 300 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] block_device_allocate_retries_interval = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cert                           = self.pem {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute_monitors               = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] config_dir                     = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] config_drive_format            = iso9660 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] config_source                  = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] console_host                   = user {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] control_exchange               = nova {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cpu_allocation_ratio           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] daemon                         = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] debug                          = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] default_access_ip_network_name = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] default_availability_zone      = nova {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] default_ephemeral_format       = ext4 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] default_schedule_zone          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] disk_allocation_ratio          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] enable_new_services            = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] enabled_ssl_apis               = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] flat_injected                  = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] force_config_drive             = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] force_raw_images               = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] graceful_shutdown_timeout      = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] heal_instance_info_cache_interval = 60 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] host                           = user {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] instance_build_timeout         = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] instance_delete_interval       = 300 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] instance_name_template         = instance-%08x {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] instance_usage_audit           = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] instance_usage_audit_period    = month {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] internal_service_availability_zone = internal {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] key                            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] live_migration_retry_count     = 30 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] log_config_append              = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] log_dir                        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] log_file                       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] log_options                    = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] log_rotate_interval            = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] log_rotate_interval_type       = days {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] log_rotation_type              = none {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] long_rpc_timeout               = 1800 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] max_concurrent_builds          = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] max_concurrent_live_migrations = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] max_concurrent_snapshots       = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] max_local_block_devices        = 3 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] max_logfile_count              = 30 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] max_logfile_size_mb            = 200 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] maximum_instance_delete_attempts = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] metadata_listen                = 0.0.0.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] metadata_listen_port           = 8775 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] metadata_workers               = 3 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] migrate_max_retries            = -1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] mkisofs_cmd                    = genisoimage {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] my_ip                          = 10.0.0.210 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] network_allocate_retries       = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] osapi_compute_listen_port      = 8774 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] osapi_compute_unique_server_name_scope =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] osapi_compute_workers          = 3 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] password_length                = 12 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] periodic_enable                = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] periodic_fuzzy_delay           = 60 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] pointer_model                  = ps2mouse {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] preallocate_images             = none {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] publish_errors                 = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] pybasedir                      = /opt/stack/nova {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ram_allocation_ratio           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] rate_limit_burst               = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] rate_limit_except_level        = CRITICAL {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] rate_limit_interval            = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] reboot_timeout                 = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] reclaim_instance_interval      = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] record                         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] reimage_timeout_per_gb         = 60 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] report_interval                = 120 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] rescue_timeout                 = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] reserved_host_cpus             = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] reserved_host_disk_mb          = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] reserved_host_memory_mb        = 512 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] reserved_huge_pages            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] resize_confirm_window          = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] resize_fs_using_block_device   = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] resume_guests_state_on_host_boot = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] rpc_response_timeout           = 60 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] run_external_periodic_tasks    = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] running_deleted_instance_action = reap {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] running_deleted_instance_timeout = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] scheduler_instance_sync_interval = 120 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] service_down_time              = 720 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] servicegroup_driver            = db {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] shelved_offload_time           = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] shelved_poll_interval          = 3600 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] shutdown_timeout               = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] source_is_ipv6                 = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ssl_only                       = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] state_path                     = /opt/stack/data/nova {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] sync_power_state_interval      = 600 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] sync_power_state_pool_size     = 1000 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] syslog_log_facility            = LOG_USER {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] tempdir                        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] timeout_nbd                    = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] transport_url                  = **** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] update_resources_interval      = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] use_cow_images                 = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] use_eventlog                   = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] use_journal                    = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] use_json                       = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] use_rootwrap_daemon            = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] use_stderr                     = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] use_syslog                     = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vcpu_pin_set                   = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plugging_is_fatal          = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plugging_timeout           = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] virt_mkfs                      = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] volume_usage_poll_interval     = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] watch_log_file                 = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] web                            = /usr/share/spice-html5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_concurrency.disable_process_locking = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.auth_strategy              = keystone {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.compute_link_prefix        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.dhcp_domain                = novalocal {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.enable_instance_password   = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.glance_link_prefix         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.instance_list_per_project_cells = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.list_records_by_skipping_down_cells = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.local_metadata_per_cell    = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.max_limit                  = 1000 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.metadata_cache_expiration  = 15 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.neutron_default_tenant_id  = default {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.use_forwarded_for          = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.use_neutron_default_nets   = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.vendordata_dynamic_targets = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.vendordata_jsonfile_path   = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.backend_argument         = **** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.config_prefix            = cache.oslo {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.dead_timeout             = 60.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.debug_cache_backend      = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.enable_retry_client      = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.enable_socket_keepalive  = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.enabled                  = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.expiration_time          = 600 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.hashclient_retry_attempts = 2 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.memcache_dead_retry      = 300 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.memcache_password        =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.memcache_sasl_enabled    = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.memcache_username        =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.proxies                  = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.retry_attempts           = 2 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.retry_delay              = 0.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.socket_keepalive_count   = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.socket_keepalive_idle    = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.socket_keepalive_interval = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.tls_allowed_ciphers      = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.tls_cafile               = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.tls_certfile             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.tls_enabled              = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cache.tls_keyfile              = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.auth_section            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.auth_type               = password {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.cafile                  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.certfile                = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.collect_timing          = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.cross_az_attach         = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.debug                   = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.endpoint_template       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.http_retries            = 3 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.insecure                = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.keyfile                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.os_region_name          = RegionOne {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.split_loggers           = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cinder.timeout                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute.cpu_dedicated_set      = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute.cpu_shared_set         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute.image_type_exclude_list = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute.resource_provider_association_refresh = 300 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute.shutdown_retry_interval = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] conductor.workers              = 3 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] console.allowed_origins        = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] console.ssl_ciphers            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] console.ssl_minimum_version    = default {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] consoleauth.token_ttl          = 600 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.cafile                  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.certfile                = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.collect_timing          = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.connect_retries         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.connect_retry_delay     = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.endpoint_override       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.insecure                = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.keyfile                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.max_version             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.min_version             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.region_name             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.service_name            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.service_type            = accelerator {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.split_loggers           = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.status_code_retries     = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.status_code_retry_delay = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.timeout                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] cyborg.version                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.backend               = sqlalchemy {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.connection            = **** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.connection_debug      = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.connection_parameters =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.connection_recycle_time = 3600 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.connection_trace      = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.db_inc_retry_interval = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.db_max_retries        = 20 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.db_max_retry_interval = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.db_retry_interval     = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.max_overflow          = 50 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.max_pool_size         = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.max_retries           = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.mysql_enable_ndb      = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.mysql_wsrep_sync_wait = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.pool_timeout          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.retry_interval        = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.slave_connection      = **** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] database.sqlite_synchronous    = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.backend           = sqlalchemy {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.connection        = **** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.connection_debug  = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.connection_parameters =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.connection_recycle_time = 3600 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.connection_trace  = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.db_inc_retry_interval = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.db_max_retries    = 20 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.db_max_retry_interval = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.db_retry_interval = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.max_overflow      = 50 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.max_pool_size     = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.max_retries       = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.mysql_enable_ndb  = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.pool_timeout      = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.retry_interval    = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.slave_connection  = **** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] api_database.sqlite_synchronous = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] devices.enabled_mdev_types     = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ephemeral_storage_encryption.enabled = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.api_servers             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.cafile                  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.certfile                = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.collect_timing          = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.connect_retries         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.connect_retry_delay     = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.debug                   = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.default_trusted_certificate_ids = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.enable_certificate_validation = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.enable_rbd_download     = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.endpoint_override       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.insecure                = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.keyfile                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.max_version             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.min_version             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.num_retries             = 3 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.rbd_ceph_conf           =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.rbd_connect_timeout     = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.rbd_pool                =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.rbd_user                =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.region_name             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.service_name            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.service_type            = image {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.split_loggers           = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.status_code_retries     = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.status_code_retry_delay = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.timeout                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.verify_glance_signatures = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] glance.version                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] guestfs.debug                  = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.config_drive_cdrom      = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.config_drive_inject_password = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.enable_remotefx         = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.instances_path_share    =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.limit_cpu_features      = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.use_multipath_io        = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.vswitch_name            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] mks.enabled                    = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] image_cache.manager_interval   = 2400 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] image_cache.precache_concurrency = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] image_cache.remove_unused_base_images = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] image_cache.subdirectory_name  = _base {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.api_max_retries         = 60 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.api_retry_interval      = 2 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.auth_section            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.auth_type               = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.cafile                  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.certfile                = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.collect_timing          = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.connect_retries         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.connect_retry_delay     = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.endpoint_override       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.insecure                = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.keyfile                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.max_version             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.min_version             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.partition_key           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.peer_list               = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.region_name             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.serial_console_state_timeout = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.service_name            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.service_type            = baremetal {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.split_loggers           = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.status_code_retries     = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.status_code_retry_delay = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.timeout                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ironic.version                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] key_manager.fixed_key          = **** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.barbican_api_version  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.barbican_endpoint     = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.barbican_endpoint_type = public {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.barbican_region_name  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.cafile                = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.certfile              = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.collect_timing        = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.insecure              = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.keyfile               = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.number_of_retries     = 60 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.retry_delay           = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.send_service_user_token = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.split_loggers         = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.timeout               = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.verify_ssl            = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican.verify_ssl_path       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican_service_user.auth_section = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican_service_user.auth_type = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican_service_user.cafile   = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican_service_user.certfile = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican_service_user.collect_timing = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican_service_user.insecure = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican_service_user.keyfile  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican_service_user.split_loggers = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] barbican_service_user.timeout  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.approle_role_id          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.approle_secret_id        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.cafile                   = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.certfile                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.collect_timing           = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.insecure                 = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.keyfile                  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.kv_mountpoint            = secret {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.kv_version               = 2 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.namespace                = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.root_token_id            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.split_loggers            = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.ssl_ca_crt_file          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.timeout                  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.use_ssl                  = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.cafile                = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.certfile              = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.collect_timing        = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.connect_retries       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.connect_retry_delay   = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.endpoint_override     = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.insecure              = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.keyfile               = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.max_version           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.min_version           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.region_name           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.service_name          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.service_type          = identity {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.split_loggers         = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.status_code_retries   = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.status_code_retry_delay = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.timeout               = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] keystone.version               = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.connection_uri         =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.cpu_mode               = custom {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: WARNING oslo_config.cfg [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.cpu_power_governor_high = performance {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.cpu_power_management   = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.device_detach_attempts = 8 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.device_detach_timeout  = 20 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.disk_cachemodes        = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.disk_prefix            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.enabled_perf_events    = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.file_backed_memory     = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.gid_maps               = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.hw_disk_discard        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.hw_machine_type        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.images_rbd_pool        = rbd {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.images_type            = default {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.images_volume_group    = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.inject_key             = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.inject_partition       = -2 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.inject_password        = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.iscsi_iface            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.iser_use_multipath     = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_downtime = 500 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_inbound_addr = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_scheme  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_timeout_action = abort {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_tunnelled = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: WARNING oslo_config.cfg [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 17 19:49:17 user nova-compute[72815]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 17 19:49:17 user nova-compute[72815]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 17 19:49:17 user nova-compute[72815]: and ``live_migration_inbound_addr`` respectively.
Aug 17 19:49:17 user nova-compute[72815]: ).  Its value may be silently ignored in the future.
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.live_migration_with_native_tls = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.max_queues             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.nfs_mount_options      = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.num_pcie_ports         = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.pmem_namespaces        = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.quobyte_client_cfg     = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.rbd_secret_uuid        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.rbd_user               = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.rescue_image_id        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.rescue_kernel_id       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.rx_queue_size          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.smbfs_mount_options    =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.snapshot_compression   = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.snapshot_image_format  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.sparse_logical_volumes = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.swtpm_enabled          = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.swtpm_group            = tss {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.swtpm_user             = tss {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.sysinfo_serial         = unique {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.tb_cache_size          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.tx_queue_size          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.uid_maps               = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.use_virtio_for_bridges = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.virt_type              = kvm {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.volume_clear           = zero {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.volume_clear_size      = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.volume_use_multipath   = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.vzstorage_cache_path   = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.auth_section           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.auth_type              = password {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.cafile                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.certfile               = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.collect_timing         = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.connect_retries        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.connect_retry_delay    = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.default_floating_pool  = public {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.endpoint_override      = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.extension_sync_interval = 600 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.http_retries           = 3 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.insecure               = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.keyfile                = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.max_version            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.min_version            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.ovs_bridge             = br-int {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.physnets               = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.region_name            = RegionOne {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.service_metadata_proxy = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.service_name           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.service_type           = network {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.split_loggers          = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.status_code_retries    = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.status_code_retry_delay = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.timeout                = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] neutron.version                = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] notifications.bdms_in_notifications = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] notifications.default_level    = INFO {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] notifications.notification_format = unversioned {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] notifications.notify_on_state_change = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] pci.alias                      = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] pci.device_spec                = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] pci.report_in_placement        = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.auth_section         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.auth_type            = password {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.cafile               = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.certfile             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.collect_timing       = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.connect_retries      = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.connect_retry_delay  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.default_domain_id    = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.default_domain_name  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.domain_id            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.domain_name          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.endpoint_override    = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.insecure             = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.keyfile              = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.max_version          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.min_version          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.password             = **** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.project_domain_id    = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.project_domain_name  = Default {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.project_id           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.project_name         = service {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.region_name          = RegionOne {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.service_name         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.service_type         = placement {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.split_loggers        = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.status_code_retries  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.status_code_retry_delay = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.system_scope         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.timeout              = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.trust_id             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.user_domain_id       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.user_domain_name     = Default {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.user_id              = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.username             = placement {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] placement.version              = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.cores                    = 20 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.count_usage_from_placement = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.injected_file_content_bytes = 10240 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.injected_file_path_length = 255 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.injected_files           = 5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.instances                = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.key_pairs                = 100 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.metadata_items           = 128 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.ram                      = 51200 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.recheck_quota            = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.server_group_members     = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] quota.server_groups            = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] rdp.enabled                    = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] scheduler.image_metadata_prefilter = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] scheduler.max_attempts         = 3 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] scheduler.max_placement_results = 1000 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] scheduler.workers              = 3 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.host_subset_size = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.isolated_hosts = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.isolated_images = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.pci_in_placement = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.track_instance_changes = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] metrics.required               = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] metrics.weight_multiplier      = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] metrics.weight_setting         = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] serial_console.enabled         = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] serial_console.port_range      = 10000:20000 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] serial_console.serialproxy_port = 6083 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] service_user.auth_section      = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] service_user.auth_type         = password {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] service_user.cafile            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] service_user.certfile          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] service_user.collect_timing    = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] service_user.insecure          = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] service_user.keyfile           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] service_user.send_service_user_token = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] service_user.split_loggers     = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] service_user.timeout           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] spice.agent_enabled            = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] spice.enabled                  = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] spice.html5proxy_port          = 6082 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] spice.image_compression        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] spice.jpeg_compression         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] spice.playback_compression     = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] spice.server_listen            = 127.0.0.1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] spice.streaming_mode           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] spice.zlib_compression         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] upgrade_levels.baseapi         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] upgrade_levels.cert            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] upgrade_levels.compute         = auto {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] upgrade_levels.conductor       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] upgrade_levels.scheduler       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vendordata_dynamic_auth.cafile = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vendordata_dynamic_auth.certfile = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vendordata_dynamic_auth.insecure = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vendordata_dynamic_auth.timeout = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.api_retry_count         = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.ca_file                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.cache_prefix            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.cluster_name            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.connection_pool_size    = 10 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.console_delay_seconds   = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.datastore_regex         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.host_ip                 = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.host_password           = **** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.host_port               = 443 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.host_username           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.insecure                = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.integration_bridge      = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.maximum_objects         = 100 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.pbm_default_policy      = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.pbm_enabled             = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.pbm_wsdl_location       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.serial_port_proxy_uri   = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.serial_port_service_uri = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.task_poll_interval      = 0.5 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.use_linked_clone        = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.vnc_keymap              = en-us {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.vnc_port                = 5900 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vmware.vnc_port_total          = 10000 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vnc.auth_schemes               = ['none'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vnc.enabled                    = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vnc.novncproxy_port            = 6080 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vnc.vencrypt_ca_certs          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vnc.vencrypt_client_cert       = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vnc.vencrypt_client_key        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.disable_rootwrap   = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.enable_numa_live_migration = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.libvirt_disable_apic = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] wsgi.client_socket_timeout     = 900 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] wsgi.default_pool_size         = 1000 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] wsgi.keep_alive                = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] wsgi.max_header_line           = 16384 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] wsgi.ssl_ca_file               = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] wsgi.ssl_cert_file             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] wsgi.ssl_key_file              = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] wsgi.tcp_keepidle              = 600 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] zvm.ca_file                    = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] zvm.cloud_connector_url        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] zvm.reachable_timeout          = 300 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_policy.enforce_new_defaults = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_policy.enforce_scope      = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_policy.policy_default_rule = default {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler.connection_string     = messaging:// {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler.enabled               = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler.es_doc_type           = notification {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler.es_scroll_size        = 10000 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler.es_scroll_time        = 2m {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler.filter_error_trace    = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler.hmac_keys             = **** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler.sentinel_service_name = mymaster {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler.socket_timeout        = 0.1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler.trace_requests        = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler.trace_sqlalchemy      = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler_jaeger.process_tags   = {} {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler_jaeger.service_name_prefix = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] profiler_otlp.service_name_prefix = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] remote_debug.host              = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] remote_debug.port              = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_notifications.retry = -1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.auth_section        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.auth_type           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.cafile              = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.certfile            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.collect_timing      = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.connect_retries     = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.connect_retry_delay = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.endpoint_id         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.endpoint_override   = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.insecure            = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.keyfile             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.max_version         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.min_version         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.region_name         = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.service_name        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.service_type        = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.split_loggers       = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.status_code_retries = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.status_code_retry_delay = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.timeout             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.valid_interfaces    = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_limit.version             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_reports.file_event_handler = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] oslo_reports.log_dir           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plug_ovs_privileged.group  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] vif_plug_ovs_privileged.user   = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_ovs.isolate_vif         = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] os_brick.lock_path             = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] privsep_osbrick.capabilities   = [21] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] privsep_osbrick.group          = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] privsep_osbrick.helper_command = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] privsep_osbrick.user           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] nova_sys_admin.group           = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] nova_sys_admin.helper_command  = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] nova_sys_admin.user            = None {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG oslo_service.service [None req-f22dce37-e02d-4b2b-bba7-ca59bf7f8d33 None None] ******************************************************************************** {{(pid=72815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 17 19:49:17 user nova-compute[72815]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 17 19:49:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Starting native event thread {{(pid=72815) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Starting green dispatch thread {{(pid=72815) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Starting connection event dispatch thread {{(pid=72815) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Connecting to libvirt: qemu:///system {{(pid=72815) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f39b8b54f10> {{(pid=72815) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 17 19:49:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f39b8b54f10> {{(pid=72815) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 17 19:49:17 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Connection event '1' reason 'None'
Aug 17 19:49:17 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 19:49:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.mount [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Initialising _HostMountState generation 0 {{(pid=72815) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 17 19:49:24 user nova-compute[72815]: INFO nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Libvirt host capabilities <capabilities>
Aug 17 19:49:24 user nova-compute[72815]:   <host>
Aug 17 19:49:24 user nova-compute[72815]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 17 19:49:24 user nova-compute[72815]:     <cpu>
Aug 17 19:49:24 user nova-compute[72815]:       <arch>x86_64</arch>
Aug 17 19:49:24 user nova-compute[72815]:       <model>IvyBridge-IBRS</model>
Aug 17 19:49:24 user nova-compute[72815]:       <vendor>Intel</vendor>
Aug 17 19:49:24 user nova-compute[72815]:       <microcode version='1070'/>
Aug 17 19:49:24 user nova-compute[72815]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 17 19:49:24 user nova-compute[72815]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='ss'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='vmx'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='pcid'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='osxsave'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='hypervisor'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='arat'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='tsc_adjust'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='md-clear'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='stibp'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='arch-capabilities'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='ssbd'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='invtsc'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='rsba'/>
Aug 17 19:49:24 user nova-compute[72815]:       <feature name='skip-l1dfl-vmentry'/>
Aug 17 19:49:24 user nova-compute[72815]:       <pages unit='KiB' size='4'/>
Aug 17 19:49:24 user nova-compute[72815]:       <pages unit='KiB' size='2048'/>
Aug 17 19:49:24 user nova-compute[72815]:     </cpu>
Aug 17 19:49:24 user nova-compute[72815]:     <power_management>
Aug 17 19:49:24 user nova-compute[72815]:       <suspend_mem/>
Aug 17 19:49:24 user nova-compute[72815]:       <suspend_disk/>
Aug 17 19:49:24 user nova-compute[72815]:       <suspend_hybrid/>
Aug 17 19:49:24 user nova-compute[72815]:     </power_management>
Aug 17 19:49:24 user nova-compute[72815]:     <iommu support='no'/>
Aug 17 19:49:24 user nova-compute[72815]:     <migration_features>
Aug 17 19:49:24 user nova-compute[72815]:       <live/>
Aug 17 19:49:24 user nova-compute[72815]:       <uri_transports>
Aug 17 19:49:24 user nova-compute[72815]:         <uri_transport>tcp</uri_transport>
Aug 17 19:49:24 user nova-compute[72815]:         <uri_transport>rdma</uri_transport>
Aug 17 19:49:24 user nova-compute[72815]:       </uri_transports>
Aug 17 19:49:24 user nova-compute[72815]:     </migration_features>
Aug 17 19:49:24 user nova-compute[72815]:     <topology>
Aug 17 19:49:24 user nova-compute[72815]:       <cells num='2'>
Aug 17 19:49:24 user nova-compute[72815]:         <cell id='0'>
Aug 17 19:49:24 user nova-compute[72815]:           <memory unit='KiB'>8189224</memory>
Aug 17 19:49:24 user nova-compute[72815]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 17 19:49:24 user nova-compute[72815]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 19:49:24 user nova-compute[72815]:           <distances>
Aug 17 19:49:24 user nova-compute[72815]:             <sibling id='0' value='10'/>
Aug 17 19:49:24 user nova-compute[72815]:             <sibling id='1' value='20'/>
Aug 17 19:49:24 user nova-compute[72815]:           </distances>
Aug 17 19:49:24 user nova-compute[72815]:           <cpus num='6'>
Aug 17 19:49:24 user nova-compute[72815]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 17 19:49:24 user nova-compute[72815]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 17 19:49:24 user nova-compute[72815]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 17 19:49:24 user nova-compute[72815]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 17 19:49:25 user nova-compute[72815]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 17 19:49:25 user nova-compute[72815]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 17 19:49:25 user nova-compute[72815]:           </cpus>
Aug 17 19:49:25 user nova-compute[72815]:         </cell>
Aug 17 19:49:25 user nova-compute[72815]:         <cell id='1'>
Aug 17 19:49:25 user nova-compute[72815]:           <memory unit='KiB'>8206460</memory>
Aug 17 19:49:25 user nova-compute[72815]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 17 19:49:25 user nova-compute[72815]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 19:49:25 user nova-compute[72815]:           <distances>
Aug 17 19:49:25 user nova-compute[72815]:             <sibling id='0' value='20'/>
Aug 17 19:49:25 user nova-compute[72815]:             <sibling id='1' value='10'/>
Aug 17 19:49:25 user nova-compute[72815]:           </distances>
Aug 17 19:49:25 user nova-compute[72815]:           <cpus num='6'>
Aug 17 19:49:25 user nova-compute[72815]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 17 19:49:25 user nova-compute[72815]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 17 19:49:25 user nova-compute[72815]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 17 19:49:25 user nova-compute[72815]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 17 19:49:25 user nova-compute[72815]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 17 19:49:25 user nova-compute[72815]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 17 19:49:25 user nova-compute[72815]:           </cpus>
Aug 17 19:49:25 user nova-compute[72815]:         </cell>
Aug 17 19:49:25 user nova-compute[72815]:       </cells>
Aug 17 19:49:25 user nova-compute[72815]:     </topology>
Aug 17 19:49:25 user nova-compute[72815]:     <cache>
Aug 17 19:49:25 user nova-compute[72815]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 17 19:49:25 user nova-compute[72815]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 17 19:49:25 user nova-compute[72815]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 17 19:49:25 user nova-compute[72815]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 17 19:49:25 user nova-compute[72815]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 17 19:49:25 user nova-compute[72815]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 17 19:49:25 user nova-compute[72815]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 17 19:49:25 user nova-compute[72815]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 17 19:49:25 user nova-compute[72815]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 17 19:49:25 user nova-compute[72815]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 17 19:49:25 user nova-compute[72815]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 17 19:49:25 user nova-compute[72815]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 17 19:49:25 user nova-compute[72815]:     </cache>
Aug 17 19:49:25 user nova-compute[72815]:     <secmodel>
Aug 17 19:49:25 user nova-compute[72815]:       <model>apparmor</model>
Aug 17 19:49:25 user nova-compute[72815]:       <doi>0</doi>
Aug 17 19:49:25 user nova-compute[72815]:     </secmodel>
Aug 17 19:49:25 user nova-compute[72815]:     <secmodel>
Aug 17 19:49:25 user nova-compute[72815]:       <model>dac</model>
Aug 17 19:49:25 user nova-compute[72815]:       <doi>0</doi>
Aug 17 19:49:25 user nova-compute[72815]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 17 19:49:25 user nova-compute[72815]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 17 19:49:25 user nova-compute[72815]:     </secmodel>
Aug 17 19:49:25 user nova-compute[72815]:   </host>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='alpha'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>64</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>clipper</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='armv6l'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>spitz</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>nuri</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>kzm</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sx1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>z2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>tosa</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>n810</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>n800</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>terrier</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>midway</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>microbit</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>verdex</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>highbank</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>akita</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>connex</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>collie</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='armv7l'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>spitz</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>nuri</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>kzm</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sx1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>z2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>tosa</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>n810</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>n800</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>terrier</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>midway</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>microbit</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>verdex</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>highbank</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>akita</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>connex</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>collie</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='aarch64'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>64</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>spitz</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>nuri</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>kzm</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sx1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>z2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>tosa</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>n810</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>n800</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>terrier</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>midway</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>microbit</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>verdex</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>raspi3b</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>highbank</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>akita</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>connex</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>collie</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <acpi default='on' toggle='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='cris'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='i686'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>isapc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>microvm</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='kvm'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <pae/>
Aug 17 19:49:25 user nova-compute[72815]:       <nonpae/>
Aug 17 19:49:25 user nova-compute[72815]:       <acpi default='on' toggle='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:       <apic default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='m68k'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>an5206</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>q800</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>next-cube</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='microblaze'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='microblazeel'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='mips'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='16'>malta</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='mipsel'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='16'>malta</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='mips64'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>64</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='16'>malta</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>pica61</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>magnum</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='mips64el'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>64</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='16'>malta</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>pica61</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>magnum</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='16'>boston</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='ppc'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mac99</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>40p</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>taihu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='ppc64'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>64</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>taihu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>40p</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mac99</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='ppc64le'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>64</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>taihu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>40p</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>mac99</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='riscv32'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='8'>spike</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>opentitan</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='8'>virt</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='riscv64'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>64</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='8'>spike</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>shakti_c</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='8'>virt</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='s390x'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>64</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='sh4'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>shix</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>r2d</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='sh4eb'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>64</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>shix</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>r2d</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='sparc'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>SS-5</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>SS-20</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>LX</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>SS-4</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>SS-10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>Voyager</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='sparc64'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>64</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sun4u</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>niagara</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>sun4v</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='x86_64'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>64</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='1'>isapc</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>microvm</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='kvm'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <acpi default='on' toggle='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:       <apic default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='xtensa'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>sim</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>kc705</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>ml605</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>virt</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>lx200</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>lx60</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]:   <guest>
Aug 17 19:49:25 user nova-compute[72815]:     <os_type>hvm</os_type>
Aug 17 19:49:25 user nova-compute[72815]:     <arch name='xtensaeb'>
Aug 17 19:49:25 user nova-compute[72815]:       <wordsize>32</wordsize>
Aug 17 19:49:25 user nova-compute[72815]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='4'>sim</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>kc705</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>ml605</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>virt</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>lx200</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>lx60</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 19:49:25 user nova-compute[72815]:       <domain type='qemu'/>
Aug 17 19:49:25 user nova-compute[72815]:     </arch>
Aug 17 19:49:25 user nova-compute[72815]:     <features>
Aug 17 19:49:25 user nova-compute[72815]:       <cpuselection/>
Aug 17 19:49:25 user nova-compute[72815]:       <deviceboot/>
Aug 17 19:49:25 user nova-compute[72815]:       <disksnapshot default='on' toggle='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     </features>
Aug 17 19:49:25 user nova-compute[72815]:   </guest>
Aug 17 19:49:25 user nova-compute[72815]: </capabilities>
Aug 17 19:49:25 user nova-compute[72815]: 
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 17 19:49:25 user nova-compute[72815]: <domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 19:49:25 user nova-compute[72815]:   <domain>kvm</domain>
Aug 17 19:49:25 user nova-compute[72815]:   <machine>pc-i440fx-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:   <arch>i686</arch>
Aug 17 19:49:25 user nova-compute[72815]:   <vcpu max='255'/>
Aug 17 19:49:25 user nova-compute[72815]:   <iothreads supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:   <os supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='firmware'/>
Aug 17 19:49:25 user nova-compute[72815]:     <loader supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>rom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pflash</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='readonly'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>yes</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='secure'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </loader>
Aug 17 19:49:25 user nova-compute[72815]:   </os>
Aug 17 19:49:25 user nova-compute[72815]:   <cpu>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-passthrough' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='hostPassthroughMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='maximum' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='maximumMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>on</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-model' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <vendor>Intel</vendor>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ss'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='vmx'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='pcid'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='hypervisor'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arat'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='umip'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='md-clear'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibpb'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibrs'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='erms'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='lm'/>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='custom' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>qemu64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>qemu32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>phenom</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>n270</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>kvm64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>kvm32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>coreduo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>core2duo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>athlon</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Westmere</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Snowridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Penryn</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G5</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G4</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G1</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Nehalem</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Rome</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Milan</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Dhyana</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cooperlake</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Conroe</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>486</model>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:   </cpu>
Aug 17 19:49:25 user nova-compute[72815]:   <memoryBacking supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='sourceType'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>file</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>anonymous</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>memfd</value>
Aug 17 19:49:25 user nova-compute[72815]:     </enum>
Aug 17 19:49:25 user nova-compute[72815]:   </memoryBacking>
Aug 17 19:49:25 user nova-compute[72815]:   <devices>
Aug 17 19:49:25 user nova-compute[72815]:     <disk supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='diskDevice'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>disk</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cdrom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>floppy</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>lun</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='bus'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>ide</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>fdc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sata</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </disk>
Aug 17 19:49:25 user nova-compute[72815]:     <graphics supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sdl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vnc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>spice</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egl-headless</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </graphics>
Aug 17 19:49:25 user nova-compute[72815]:     <video supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='modelType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cirrus</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vmvga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>qxl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>none</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>bochs</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>ramfb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </video>
Aug 17 19:49:25 user nova-compute[72815]:     <hostdev supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='mode'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>subsystem</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='startupPolicy'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>default</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>mandatory</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>requisite</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>optional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='subsysType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pci</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='capsType'/>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='pciBackend'/>
Aug 17 19:49:25 user nova-compute[72815]:     </hostdev>
Aug 17 19:49:25 user nova-compute[72815]:     <rng supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>random</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egd</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>builtin</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </rng>
Aug 17 19:49:25 user nova-compute[72815]:     <filesystem supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='driverType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>path</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>handle</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtiofs</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </filesystem>
Aug 17 19:49:25 user nova-compute[72815]:     <tpm supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-tis</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-crb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>passthrough</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>emulator</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </tpm>
Aug 17 19:49:25 user nova-compute[72815]:   </devices>
Aug 17 19:49:25 user nova-compute[72815]:   <features>
Aug 17 19:49:25 user nova-compute[72815]:     <gic supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     <vmcoreinfo supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <genid supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backingStoreInput supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backup supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <sev supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:   </features>
Aug 17 19:49:25 user nova-compute[72815]: </domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:  {{(pid=72815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 17 19:49:25 user nova-compute[72815]: <domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 19:49:25 user nova-compute[72815]:   <domain>kvm</domain>
Aug 17 19:49:25 user nova-compute[72815]:   <machine>pc-i440fx-jammy</machine>
Aug 17 19:49:25 user nova-compute[72815]:   <arch>i686</arch>
Aug 17 19:49:25 user nova-compute[72815]:   <vcpu max='255'/>
Aug 17 19:49:25 user nova-compute[72815]:   <iothreads supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:   <os supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='firmware'/>
Aug 17 19:49:25 user nova-compute[72815]:     <loader supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>rom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pflash</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='readonly'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>yes</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='secure'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </loader>
Aug 17 19:49:25 user nova-compute[72815]:   </os>
Aug 17 19:49:25 user nova-compute[72815]:   <cpu>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-passthrough' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='hostPassthroughMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='maximum' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='maximumMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>on</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-model' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <vendor>Intel</vendor>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ss'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='vmx'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='pcid'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='hypervisor'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arat'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='umip'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='md-clear'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibpb'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibrs'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='erms'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='lm'/>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='custom' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>qemu64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>qemu32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>phenom</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>n270</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>kvm64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>kvm32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>coreduo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>core2duo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>athlon</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Westmere</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Snowridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Penryn</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G5</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G4</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G1</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Nehalem</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Rome</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Milan</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Dhyana</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cooperlake</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Conroe</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>486</model>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:   </cpu>
Aug 17 19:49:25 user nova-compute[72815]:   <memoryBacking supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='sourceType'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>file</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>anonymous</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>memfd</value>
Aug 17 19:49:25 user nova-compute[72815]:     </enum>
Aug 17 19:49:25 user nova-compute[72815]:   </memoryBacking>
Aug 17 19:49:25 user nova-compute[72815]:   <devices>
Aug 17 19:49:25 user nova-compute[72815]:     <disk supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='diskDevice'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>disk</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cdrom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>floppy</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>lun</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='bus'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>ide</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>fdc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sata</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </disk>
Aug 17 19:49:25 user nova-compute[72815]:     <graphics supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sdl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vnc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>spice</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egl-headless</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </graphics>
Aug 17 19:49:25 user nova-compute[72815]:     <video supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='modelType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cirrus</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vmvga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>qxl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>none</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>bochs</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>ramfb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </video>
Aug 17 19:49:25 user nova-compute[72815]:     <hostdev supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='mode'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>subsystem</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='startupPolicy'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>default</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>mandatory</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>requisite</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>optional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='subsysType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pci</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='capsType'/>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='pciBackend'/>
Aug 17 19:49:25 user nova-compute[72815]:     </hostdev>
Aug 17 19:49:25 user nova-compute[72815]:     <rng supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>random</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egd</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>builtin</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </rng>
Aug 17 19:49:25 user nova-compute[72815]:     <filesystem supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='driverType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>path</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>handle</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtiofs</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </filesystem>
Aug 17 19:49:25 user nova-compute[72815]:     <tpm supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-tis</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-crb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>passthrough</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>emulator</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </tpm>
Aug 17 19:49:25 user nova-compute[72815]:   </devices>
Aug 17 19:49:25 user nova-compute[72815]:   <features>
Aug 17 19:49:25 user nova-compute[72815]:     <gic supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     <vmcoreinfo supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <genid supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backingStoreInput supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backup supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <sev supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:   </features>
Aug 17 19:49:25 user nova-compute[72815]: </domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:  {{(pid=72815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 17 19:49:25 user nova-compute[72815]: <domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 19:49:25 user nova-compute[72815]:   <domain>kvm</domain>
Aug 17 19:49:25 user nova-compute[72815]:   <machine>pc-q35-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:   <arch>i686</arch>
Aug 17 19:49:25 user nova-compute[72815]:   <vcpu max='288'/>
Aug 17 19:49:25 user nova-compute[72815]:   <iothreads supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:   <os supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='firmware'/>
Aug 17 19:49:25 user nova-compute[72815]:     <loader supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>rom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pflash</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='readonly'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>yes</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='secure'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </loader>
Aug 17 19:49:25 user nova-compute[72815]:   </os>
Aug 17 19:49:25 user nova-compute[72815]:   <cpu>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-passthrough' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='hostPassthroughMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='maximum' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='maximumMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>on</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-model' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <vendor>Intel</vendor>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ss'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='vmx'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='pcid'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='hypervisor'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arat'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='umip'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='md-clear'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibpb'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibrs'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='erms'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='lm'/>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='custom' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>qemu64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>qemu32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>phenom</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>n270</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>kvm64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>kvm32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>coreduo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>core2duo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>athlon</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Westmere</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Snowridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Penryn</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G5</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G4</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G1</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Nehalem</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Rome</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Milan</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Dhyana</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cooperlake</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Conroe</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>486</model>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:   </cpu>
Aug 17 19:49:25 user nova-compute[72815]:   <memoryBacking supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='sourceType'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>file</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>anonymous</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>memfd</value>
Aug 17 19:49:25 user nova-compute[72815]:     </enum>
Aug 17 19:49:25 user nova-compute[72815]:   </memoryBacking>
Aug 17 19:49:25 user nova-compute[72815]:   <devices>
Aug 17 19:49:25 user nova-compute[72815]:     <disk supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='diskDevice'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>disk</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cdrom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>floppy</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>lun</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='bus'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>fdc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sata</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </disk>
Aug 17 19:49:25 user nova-compute[72815]:     <graphics supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sdl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vnc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>spice</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egl-headless</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </graphics>
Aug 17 19:49:25 user nova-compute[72815]:     <video supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='modelType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cirrus</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vmvga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>qxl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>none</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>bochs</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>ramfb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </video>
Aug 17 19:49:25 user nova-compute[72815]:     <hostdev supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='mode'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>subsystem</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='startupPolicy'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>default</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>mandatory</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>requisite</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>optional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='subsysType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pci</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='capsType'/>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='pciBackend'/>
Aug 17 19:49:25 user nova-compute[72815]:     </hostdev>
Aug 17 19:49:25 user nova-compute[72815]:     <rng supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>random</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egd</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>builtin</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </rng>
Aug 17 19:49:25 user nova-compute[72815]:     <filesystem supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='driverType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>path</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>handle</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtiofs</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </filesystem>
Aug 17 19:49:25 user nova-compute[72815]:     <tpm supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-tis</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-crb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>passthrough</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>emulator</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </tpm>
Aug 17 19:49:25 user nova-compute[72815]:   </devices>
Aug 17 19:49:25 user nova-compute[72815]:   <features>
Aug 17 19:49:25 user nova-compute[72815]:     <gic supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     <vmcoreinfo supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <genid supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backingStoreInput supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backup supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <sev supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:   </features>
Aug 17 19:49:25 user nova-compute[72815]: </domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:  {{(pid=72815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 17 19:49:25 user nova-compute[72815]: <domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 19:49:25 user nova-compute[72815]:   <domain>kvm</domain>
Aug 17 19:49:25 user nova-compute[72815]:   <machine>pc-q35-jammy</machine>
Aug 17 19:49:25 user nova-compute[72815]:   <arch>i686</arch>
Aug 17 19:49:25 user nova-compute[72815]:   <vcpu max='288'/>
Aug 17 19:49:25 user nova-compute[72815]:   <iothreads supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:   <os supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='firmware'/>
Aug 17 19:49:25 user nova-compute[72815]:     <loader supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>rom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pflash</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='readonly'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>yes</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='secure'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </loader>
Aug 17 19:49:25 user nova-compute[72815]:   </os>
Aug 17 19:49:25 user nova-compute[72815]:   <cpu>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-passthrough' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='hostPassthroughMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='maximum' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='maximumMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>on</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-model' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <vendor>Intel</vendor>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ss'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='vmx'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='pcid'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='hypervisor'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arat'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='umip'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='md-clear'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibpb'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibrs'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='erms'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='lm'/>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='custom' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>qemu64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>qemu32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>phenom</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>n270</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>kvm64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>kvm32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>coreduo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>core2duo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>athlon</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Westmere</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Snowridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Penryn</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G5</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G4</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G1</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Nehalem</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Rome</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Milan</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Dhyana</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cooperlake</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Conroe</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>486</model>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:   </cpu>
Aug 17 19:49:25 user nova-compute[72815]:   <memoryBacking supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='sourceType'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>file</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>anonymous</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>memfd</value>
Aug 17 19:49:25 user nova-compute[72815]:     </enum>
Aug 17 19:49:25 user nova-compute[72815]:   </memoryBacking>
Aug 17 19:49:25 user nova-compute[72815]:   <devices>
Aug 17 19:49:25 user nova-compute[72815]:     <disk supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='diskDevice'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>disk</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cdrom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>floppy</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>lun</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='bus'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>fdc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sata</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </disk>
Aug 17 19:49:25 user nova-compute[72815]:     <graphics supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sdl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vnc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>spice</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egl-headless</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </graphics>
Aug 17 19:49:25 user nova-compute[72815]:     <video supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='modelType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cirrus</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vmvga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>qxl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>none</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>bochs</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>ramfb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </video>
Aug 17 19:49:25 user nova-compute[72815]:     <hostdev supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='mode'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>subsystem</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='startupPolicy'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>default</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>mandatory</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>requisite</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>optional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='subsysType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pci</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='capsType'/>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='pciBackend'/>
Aug 17 19:49:25 user nova-compute[72815]:     </hostdev>
Aug 17 19:49:25 user nova-compute[72815]:     <rng supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>random</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egd</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>builtin</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </rng>
Aug 17 19:49:25 user nova-compute[72815]:     <filesystem supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='driverType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>path</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>handle</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtiofs</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </filesystem>
Aug 17 19:49:25 user nova-compute[72815]:     <tpm supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-tis</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-crb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>passthrough</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>emulator</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </tpm>
Aug 17 19:49:25 user nova-compute[72815]:   </devices>
Aug 17 19:49:25 user nova-compute[72815]:   <features>
Aug 17 19:49:25 user nova-compute[72815]:     <gic supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     <vmcoreinfo supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <genid supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backingStoreInput supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backup supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <sev supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:   </features>
Aug 17 19:49:25 user nova-compute[72815]: </domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:  {{(pid=72815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 17 19:49:25 user nova-compute[72815]: <domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 19:49:25 user nova-compute[72815]:   <domain>kvm</domain>
Aug 17 19:49:25 user nova-compute[72815]:   <machine>pc-i440fx-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:   <arch>x86_64</arch>
Aug 17 19:49:25 user nova-compute[72815]:   <vcpu max='255'/>
Aug 17 19:49:25 user nova-compute[72815]:   <iothreads supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:   <os supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='firmware'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>efi</value>
Aug 17 19:49:25 user nova-compute[72815]:     </enum>
Aug 17 19:49:25 user nova-compute[72815]:     <loader supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>rom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pflash</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='readonly'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>yes</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='secure'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </loader>
Aug 17 19:49:25 user nova-compute[72815]:   </os>
Aug 17 19:49:25 user nova-compute[72815]:   <cpu>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-passthrough' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='hostPassthroughMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>on</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='maximum' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='maximumMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>on</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-model' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <vendor>Intel</vendor>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ss'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='vmx'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='pcid'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='hypervisor'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arat'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='umip'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='md-clear'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='invtsc'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibpb'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibrs'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='rsba'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='erms'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='custom' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>qemu64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>qemu32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>phenom</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>n270</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>kvm64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>kvm32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>coreduo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>core2duo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>athlon</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Westmere</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Snowridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Penryn</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G5</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G4</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Opteron_G1</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Nehalem</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Rome</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Milan</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Dhyana</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cooperlake</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Conroe</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>486</model>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:   </cpu>
Aug 17 19:49:25 user nova-compute[72815]:   <memoryBacking supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='sourceType'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>file</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>anonymous</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>memfd</value>
Aug 17 19:49:25 user nova-compute[72815]:     </enum>
Aug 17 19:49:25 user nova-compute[72815]:   </memoryBacking>
Aug 17 19:49:25 user nova-compute[72815]:   <devices>
Aug 17 19:49:25 user nova-compute[72815]:     <disk supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='diskDevice'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>disk</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cdrom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>floppy</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>lun</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='bus'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>ide</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>fdc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sata</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </disk>
Aug 17 19:49:25 user nova-compute[72815]:     <graphics supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sdl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vnc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>spice</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egl-headless</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </graphics>
Aug 17 19:49:25 user nova-compute[72815]:     <video supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='modelType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cirrus</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vmvga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>qxl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>none</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>bochs</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>ramfb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </video>
Aug 17 19:49:25 user nova-compute[72815]:     <hostdev supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='mode'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>subsystem</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='startupPolicy'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>default</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>mandatory</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>requisite</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>optional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='subsysType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pci</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='capsType'/>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='pciBackend'/>
Aug 17 19:49:25 user nova-compute[72815]:     </hostdev>
Aug 17 19:49:25 user nova-compute[72815]:     <rng supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>random</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egd</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>builtin</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </rng>
Aug 17 19:49:25 user nova-compute[72815]:     <filesystem supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='driverType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>path</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>handle</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtiofs</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </filesystem>
Aug 17 19:49:25 user nova-compute[72815]:     <tpm supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-tis</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-crb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>passthrough</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>emulator</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </tpm>
Aug 17 19:49:25 user nova-compute[72815]:   </devices>
Aug 17 19:49:25 user nova-compute[72815]:   <features>
Aug 17 19:49:25 user nova-compute[72815]:     <gic supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     <vmcoreinfo supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <genid supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backingStoreInput supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backup supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <sev supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:   </features>
Aug 17 19:49:25 user nova-compute[72815]: </domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:  {{(pid=72815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 17 19:49:25 user nova-compute[72815]: <domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 19:49:25 user nova-compute[72815]:   <domain>kvm</domain>
Aug 17 19:49:25 user nova-compute[72815]:   <machine>pc-i440fx-jammy</machine>
Aug 17 19:49:25 user nova-compute[72815]:   <arch>x86_64</arch>
Aug 17 19:49:25 user nova-compute[72815]:   <vcpu max='255'/>
Aug 17 19:49:25 user nova-compute[72815]:   <iothreads supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:   <os supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='firmware'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>efi</value>
Aug 17 19:49:25 user nova-compute[72815]:     </enum>
Aug 17 19:49:25 user nova-compute[72815]:     <loader supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>rom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pflash</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='readonly'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>yes</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='secure'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </loader>
Aug 17 19:49:25 user nova-compute[72815]:   </os>
Aug 17 19:49:25 user nova-compute[72815]:   <cpu>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-passthrough' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='hostPassthroughMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>on</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='maximum' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='maximumMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>on</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-model' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <vendor>Intel</vendor>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ss'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='vmx'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='pcid'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='hypervisor'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arat'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='umip'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='md-clear'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='invtsc'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibpb'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibrs'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='rsba'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='erms'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='custom' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>qemu64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>qemu32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>phenom</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>n270</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>kvm64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>kvm32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>coreduo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>core2duo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>athlon</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Westmere</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Snowridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Penryn</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G5</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G4</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Opteron_G1</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Nehalem</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Rome</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Milan</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Dhyana</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cooperlake</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Conroe</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>486</model>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:   </cpu>
Aug 17 19:49:25 user nova-compute[72815]:   <memoryBacking supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='sourceType'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>file</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>anonymous</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>memfd</value>
Aug 17 19:49:25 user nova-compute[72815]:     </enum>
Aug 17 19:49:25 user nova-compute[72815]:   </memoryBacking>
Aug 17 19:49:25 user nova-compute[72815]:   <devices>
Aug 17 19:49:25 user nova-compute[72815]:     <disk supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='diskDevice'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>disk</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cdrom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>floppy</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>lun</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='bus'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>ide</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>fdc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sata</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </disk>
Aug 17 19:49:25 user nova-compute[72815]:     <graphics supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sdl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vnc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>spice</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egl-headless</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </graphics>
Aug 17 19:49:25 user nova-compute[72815]:     <video supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='modelType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cirrus</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vmvga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>qxl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>none</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>bochs</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>ramfb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </video>
Aug 17 19:49:25 user nova-compute[72815]:     <hostdev supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='mode'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>subsystem</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='startupPolicy'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>default</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>mandatory</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>requisite</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>optional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='subsysType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pci</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='capsType'/>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='pciBackend'/>
Aug 17 19:49:25 user nova-compute[72815]:     </hostdev>
Aug 17 19:49:25 user nova-compute[72815]:     <rng supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>random</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egd</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>builtin</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </rng>
Aug 17 19:49:25 user nova-compute[72815]:     <filesystem supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='driverType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>path</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>handle</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtiofs</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </filesystem>
Aug 17 19:49:25 user nova-compute[72815]:     <tpm supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-tis</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-crb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>passthrough</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>emulator</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </tpm>
Aug 17 19:49:25 user nova-compute[72815]:   </devices>
Aug 17 19:49:25 user nova-compute[72815]:   <features>
Aug 17 19:49:25 user nova-compute[72815]:     <gic supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     <vmcoreinfo supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <genid supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backingStoreInput supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backup supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <sev supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:   </features>
Aug 17 19:49:25 user nova-compute[72815]: </domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:  {{(pid=72815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 17 19:49:25 user nova-compute[72815]: <domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 19:49:25 user nova-compute[72815]:   <domain>kvm</domain>
Aug 17 19:49:25 user nova-compute[72815]:   <machine>pc-q35-6.2</machine>
Aug 17 19:49:25 user nova-compute[72815]:   <arch>x86_64</arch>
Aug 17 19:49:25 user nova-compute[72815]:   <vcpu max='288'/>
Aug 17 19:49:25 user nova-compute[72815]:   <iothreads supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:   <os supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='firmware'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>efi</value>
Aug 17 19:49:25 user nova-compute[72815]:     </enum>
Aug 17 19:49:25 user nova-compute[72815]:     <loader supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>rom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pflash</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='readonly'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>yes</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='secure'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>yes</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </loader>
Aug 17 19:49:25 user nova-compute[72815]:   </os>
Aug 17 19:49:25 user nova-compute[72815]:   <cpu>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-passthrough' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='hostPassthroughMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>on</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='maximum' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='maximumMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>on</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-model' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <vendor>Intel</vendor>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ss'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='vmx'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='pcid'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='hypervisor'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arat'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='umip'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='md-clear'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='invtsc'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibpb'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibrs'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='rsba'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='erms'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='custom' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>qemu64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>qemu32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>phenom</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>n270</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>kvm64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>kvm32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>coreduo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>core2duo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>athlon</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Westmere</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Snowridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Penryn</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G5</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G4</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Opteron_G1</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Nehalem</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Rome</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Milan</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Dhyana</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cooperlake</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Conroe</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>486</model>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:   </cpu>
Aug 17 19:49:25 user nova-compute[72815]:   <memoryBacking supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='sourceType'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>file</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>anonymous</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>memfd</value>
Aug 17 19:49:25 user nova-compute[72815]:     </enum>
Aug 17 19:49:25 user nova-compute[72815]:   </memoryBacking>
Aug 17 19:49:25 user nova-compute[72815]:   <devices>
Aug 17 19:49:25 user nova-compute[72815]:     <disk supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='diskDevice'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>disk</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cdrom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>floppy</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>lun</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='bus'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>fdc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sata</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </disk>
Aug 17 19:49:25 user nova-compute[72815]:     <graphics supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sdl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vnc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>spice</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egl-headless</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </graphics>
Aug 17 19:49:25 user nova-compute[72815]:     <video supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='modelType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cirrus</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vmvga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>qxl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>none</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>bochs</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>ramfb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </video>
Aug 17 19:49:25 user nova-compute[72815]:     <hostdev supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='mode'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>subsystem</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='startupPolicy'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>default</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>mandatory</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>requisite</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>optional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='subsysType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pci</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='capsType'/>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='pciBackend'/>
Aug 17 19:49:25 user nova-compute[72815]:     </hostdev>
Aug 17 19:49:25 user nova-compute[72815]:     <rng supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>random</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egd</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>builtin</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </rng>
Aug 17 19:49:25 user nova-compute[72815]:     <filesystem supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='driverType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>path</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>handle</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtiofs</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </filesystem>
Aug 17 19:49:25 user nova-compute[72815]:     <tpm supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-tis</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-crb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>passthrough</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>emulator</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </tpm>
Aug 17 19:49:25 user nova-compute[72815]:   </devices>
Aug 17 19:49:25 user nova-compute[72815]:   <features>
Aug 17 19:49:25 user nova-compute[72815]:     <gic supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     <vmcoreinfo supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <genid supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backingStoreInput supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backup supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <sev supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:   </features>
Aug 17 19:49:25 user nova-compute[72815]: </domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:  {{(pid=72815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 17 19:49:25 user nova-compute[72815]: <domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 19:49:25 user nova-compute[72815]:   <domain>kvm</domain>
Aug 17 19:49:25 user nova-compute[72815]:   <machine>pc-q35-jammy</machine>
Aug 17 19:49:25 user nova-compute[72815]:   <arch>x86_64</arch>
Aug 17 19:49:25 user nova-compute[72815]:   <vcpu max='288'/>
Aug 17 19:49:25 user nova-compute[72815]:   <iothreads supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:   <os supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='firmware'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>efi</value>
Aug 17 19:49:25 user nova-compute[72815]:     </enum>
Aug 17 19:49:25 user nova-compute[72815]:     <loader supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>rom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pflash</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='readonly'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>yes</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='secure'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>yes</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>no</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </loader>
Aug 17 19:49:25 user nova-compute[72815]:   </os>
Aug 17 19:49:25 user nova-compute[72815]:   <cpu>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-passthrough' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='hostPassthroughMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>on</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='maximum' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='maximumMigratable'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>on</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>off</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='host-model' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <vendor>Intel</vendor>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ss'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='vmx'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='pcid'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='hypervisor'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arat'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='umip'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='md-clear'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='invtsc'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibpb'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='ibrs'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-stibp'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='rsba'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='erms'/>
Aug 17 19:49:25 user nova-compute[72815]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:     <mode name='custom' supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>qemu64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>qemu32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>phenom</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>pentium</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>n270</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>kvm64</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>kvm32</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>coreduo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>core2duo</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>athlon</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Westmere</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Snowridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Skylake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>SandyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Penryn</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G5</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G4</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G3</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Opteron_G2</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Opteron_G1</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Nehalem</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>IvyBridge</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Icelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Haswell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Rome</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-Milan</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>EPYC</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Dhyana</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cooperlake</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>Conroe</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='no'>Broadwell</model>
Aug 17 19:49:25 user nova-compute[72815]:       <model usable='yes'>486</model>
Aug 17 19:49:25 user nova-compute[72815]:     </mode>
Aug 17 19:49:25 user nova-compute[72815]:   </cpu>
Aug 17 19:49:25 user nova-compute[72815]:   <memoryBacking supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:     <enum name='sourceType'>
Aug 17 19:49:25 user nova-compute[72815]:       <value>file</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>anonymous</value>
Aug 17 19:49:25 user nova-compute[72815]:       <value>memfd</value>
Aug 17 19:49:25 user nova-compute[72815]:     </enum>
Aug 17 19:49:25 user nova-compute[72815]:   </memoryBacking>
Aug 17 19:49:25 user nova-compute[72815]:   <devices>
Aug 17 19:49:25 user nova-compute[72815]:     <disk supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='diskDevice'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>disk</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cdrom</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>floppy</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>lun</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='bus'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>fdc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sata</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </disk>
Aug 17 19:49:25 user nova-compute[72815]:     <graphics supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='type'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>sdl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vnc</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>spice</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egl-headless</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </graphics>
Aug 17 19:49:25 user nova-compute[72815]:     <video supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='modelType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>cirrus</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>vmvga</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>qxl</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>none</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>bochs</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>ramfb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </video>
Aug 17 19:49:25 user nova-compute[72815]:     <hostdev supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='mode'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>subsystem</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='startupPolicy'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>default</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>mandatory</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>requisite</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>optional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='subsysType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>usb</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>pci</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>scsi</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='capsType'/>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='pciBackend'/>
Aug 17 19:49:25 user nova-compute[72815]:     </hostdev>
Aug 17 19:49:25 user nova-compute[72815]:     <rng supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtio-non-transitional</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>random</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>egd</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>builtin</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </rng>
Aug 17 19:49:25 user nova-compute[72815]:     <filesystem supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='driverType'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>path</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>handle</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>virtiofs</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </filesystem>
Aug 17 19:49:25 user nova-compute[72815]:     <tpm supported='yes'>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='model'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-tis</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>tpm-crb</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:       <enum name='backendModel'>
Aug 17 19:49:25 user nova-compute[72815]:         <value>passthrough</value>
Aug 17 19:49:25 user nova-compute[72815]:         <value>emulator</value>
Aug 17 19:49:25 user nova-compute[72815]:       </enum>
Aug 17 19:49:25 user nova-compute[72815]:     </tpm>
Aug 17 19:49:25 user nova-compute[72815]:   </devices>
Aug 17 19:49:25 user nova-compute[72815]:   <features>
Aug 17 19:49:25 user nova-compute[72815]:     <gic supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:     <vmcoreinfo supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <genid supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backingStoreInput supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <backup supported='yes'/>
Aug 17 19:49:25 user nova-compute[72815]:     <sev supported='no'/>
Aug 17 19:49:25 user nova-compute[72815]:   </features>
Aug 17 19:49:25 user nova-compute[72815]: </domainCapabilities>
Aug 17 19:49:25 user nova-compute[72815]:  {{(pid=72815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Checking secure boot support for host arch (x86_64) {{(pid=72815) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Checking secure boot support for host arch (x86_64) {{(pid=72815) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Checking secure boot support for host arch (x86_64) {{(pid=72815) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Checking secure boot support for host arch (x86_64) {{(pid=72815) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Checking secure boot support for host arch (x86_64) {{(pid=72815) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 19:49:25 user nova-compute[72815]: INFO nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Secure Boot support detected
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] cpu compare xml: <cpu match="exact">
Aug 17 19:49:25 user nova-compute[72815]:   <model>Nehalem</model>
Aug 17 19:49:25 user nova-compute[72815]: </cpu>
Aug 17 19:49:25 user nova-compute[72815]:  {{(pid=72815) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 17 19:49:25 user nova-compute[72815]: INFO nova.virt.node [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Generated node identity d6bf6002-de69-45c8-b950-cf2491d2cb73
Aug 17 19:49:25 user nova-compute[72815]: INFO nova.virt.node [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Wrote node identity d6bf6002-de69-45c8-b950-cf2491d2cb73 to /opt/stack/data/nova/compute_id
Aug 17 19:49:25 user nova-compute[72815]: WARNING nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Compute nodes ['d6bf6002-de69-45c8-b950-cf2491d2cb73'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 17 19:49:25 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 17 19:49:25 user nova-compute[72815]: WARNING nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 19:49:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:49:25 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:49:25 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Hypervisor/Node resource view: name=user free_ram=10862MB free_disk=26.46944808959961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:49:25 user nova-compute[72815]: WARNING nova.compute.resource_tracker [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] No compute node record for user:d6bf6002-de69-45c8-b950-cf2491d2cb73: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d6bf6002-de69-45c8-b950-cf2491d2cb73 could not be found.
Aug 17 19:49:25 user nova-compute[72815]: INFO nova.compute.resource_tracker [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Compute node record created for user:user with uuid: d6bf6002-de69-45c8-b950-cf2491d2cb73
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:49:25 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:49:25 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [req-fa6c56b8-d70a-4aea-8cad-cd8304454e5b] Created resource provider record via placement API for resource provider with UUID d6bf6002-de69-45c8-b950-cf2491d2cb73 and name user.
Aug 17 19:49:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72815) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 17 19:49:26 user nova-compute[72815]: INFO nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] kernel doesn't support AMD SEV
Aug 17 19:49:26 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Updating inventory in ProviderTree for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 19:49:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:49:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Libvirt baseline CPU <cpu>
Aug 17 19:49:26 user nova-compute[72815]:   <arch>x86_64</arch>
Aug 17 19:49:26 user nova-compute[72815]:   <model>Nehalem</model>
Aug 17 19:49:26 user nova-compute[72815]:   <vendor>Intel</vendor>
Aug 17 19:49:26 user nova-compute[72815]:   <topology sockets="6" cores="1" threads="1"/>
Aug 17 19:49:26 user nova-compute[72815]: </cpu>
Aug 17 19:49:26 user nova-compute[72815]:  {{(pid=72815) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 17 19:49:26 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Updated inventory for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 17 19:49:26 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Updating resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73 generation from 0 to 1 during operation: update_inventory {{(pid=72815) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 19:49:26 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Updating inventory in ProviderTree for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 19:49:26 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Updating resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73 generation from 1 to 2 during operation: update_traits {{(pid=72815) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 19:49:26 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:49:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:49:26 user nova-compute[72815]: DEBUG nova.service [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Creating RPC server for service compute {{(pid=72815) start /opt/stack/nova/nova/service.py:182}}
Aug 17 19:49:26 user nova-compute[72815]: DEBUG nova.service [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Join ServiceGroup membership for this service compute {{(pid=72815) start /opt/stack/nova/nova/service.py:199}}
Aug 17 19:49:26 user nova-compute[72815]: DEBUG nova.servicegroup.drivers.db [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72815) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:50:17 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:50:17 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:50:17 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=10289MB free_disk=26.373165130615234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:50:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:51:17 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:51:17 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:51:17 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=10219MB free_disk=26.419776916503906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:51:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:51:18 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:51:18 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:51:18 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:51:18 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:51:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:51:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:51:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 19:51:18 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:51:18 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:51:18 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:51:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:52:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:52:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:52:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:52:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:52:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:52:17 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:52:18 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:52:18 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:52:18 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=10230MB free_disk=26.203475952148438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:52:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:52:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:52:18 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:52:18 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:52:18 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:52:18 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:52:18 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:52:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:52:19 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:52:19 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:52:19 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:52:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:52:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:52:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 19:52:19 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:52:19 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:52:20 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:52:20 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:52:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:53:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:53:18 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:53:18 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:53:19 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:53:19 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:53:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:19 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:53:20 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:53:20 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:53:20 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=9436MB free_disk=26.226242065429688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:53:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:20 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:53:20 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:53:20 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:53:20 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:53:20 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:53:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:21 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:53:21 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:53:21 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:53:21 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 19:53:21 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:53:21 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:53:21 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:53:21 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:53:22 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:53:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "f5ba4305-b304-46d5-8069-37abab0e430d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "f5ba4305-b304-46d5-8069-37abab0e430d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:24 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:53:25 user nova-compute[72815]: INFO nova.compute.claims [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Claim successful on node user
Aug 17 19:53:25 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:53:25 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:53:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:53:25 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Creating image(s)
Aug 17 19:53:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "/opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "/opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28.part --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:26 user nova-compute[72815]: DEBUG nova.policy [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81819d9f8bc24f19b0702d986df7cf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd7362f5e44004a7adeb21f40e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:53:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28.part --force-share --output=json" returned: 0 in 0.157s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:26 user nova-compute[72815]: DEBUG nova.virt.images [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] 03ea87a0-d39d-476c-ae9f-307cb35323b8 was qcow2, converting to raw {{(pid=72815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 19:53:26 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 19:53:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28.part /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28.converted {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28.part /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28.converted" returned: 0 in 0.386s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28.converted --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28.converted --force-share --output=json" returned: 0 in 0.165s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.415s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:27 user nova-compute[72815]: INFO oslo.privsep.daemon [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvvxnuqdg/privsep.sock']
Aug 17 19:53:27 user sudo[82086]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvvxnuqdg/privsep.sock
Aug 17 19:53:27 user sudo[82086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 19:53:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "1a714bfa-0b06-4ef8-865a-819abbc64be5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:27 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:53:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:53:28 user nova-compute[72815]: INFO nova.compute.claims [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Claim successful on node user
Aug 17 19:53:28 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:53:28 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:53:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:53:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:53:28 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:53:28 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:53:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:53:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:53:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:53:28 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Creating image(s)
Aug 17 19:53:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "/opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "/opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:29 user sudo[82086]: pam_unix(sudo:session): session closed for user root
Aug 17 19:53:29 user nova-compute[72815]: INFO oslo.privsep.daemon [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Spawned new privsep daemon via rootwrap
Aug 17 19:53:29 user nova-compute[72815]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 19:53:29 user nova-compute[72815]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 19:53:29 user nova-compute[72815]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 17 19:53:29 user nova-compute[72815]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82098
Aug 17 19:53:29 user nova-compute[72815]: WARNING oslo_privsep.priv_context [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] privsep daemon already running
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG nova.policy [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '169121564e514d4f883b71abeb3e6070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c20bd5232b4b058abc1b50f38cade3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.216s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk 1073741824" returned: 0 in 0.042s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.242s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Successfully created port: 2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.230s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.239s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk 1073741824" returned: 0 in 0.050s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Cannot resize image /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lazy-loading 'migration_context' on Instance uuid f5ba4305-b304-46d5-8069-37abab0e430d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Ensure instance console log exists: /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.199s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Cannot resize image /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'migration_context' on Instance uuid 1a714bfa-0b06-4ef8-865a-819abbc64be5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Ensure instance console log exists: /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:32 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Successfully created port: 0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:53:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "ab784398-43df-4214-bdd3-22c652ac710f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "ab784398-43df-4214-bdd3-22c652ac710f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:53:33 user nova-compute[72815]: INFO nova.compute.claims [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Claim successful on node user
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Successfully updated port: 2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "refresh_cache-f5ba4305-b304-46d5-8069-37abab0e430d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquired lock "refresh_cache-f5ba4305-b304-46d5-8069-37abab0e430d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:53:33 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:53:33 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Creating image(s)
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "/opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.011s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "/opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.191s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-b98f4bf8-e451-4adf-995d-387f9276ff4c req-4e82da81-a65f-4722-8553-848dd833cb19 service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Received event network-changed-2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-b98f4bf8-e451-4adf-995d-387f9276ff4c req-4e82da81-a65f-4722-8553-848dd833cb19 service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Refreshing instance network info cache due to event network-changed-2730a429-8948-4303-8bba-ec78e215a242. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b98f4bf8-e451-4adf-995d-387f9276ff4c req-4e82da81-a65f-4722-8553-848dd833cb19 service nova] Acquiring lock "refresh_cache-f5ba4305-b304-46d5-8069-37abab0e430d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:53:33 user nova-compute[72815]: DEBUG nova.policy [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9821282c73174c448f7fca6b65676f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0708d4f49ed4c96b108d1d2aff76871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.164s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk 1073741824" returned: 0 in 0.058s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.169s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Cannot resize image /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.objects.instance [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'migration_context' on Instance uuid ab784398-43df-4214-bdd3-22c652ac710f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Ensure instance console log exists: /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Updating instance_info_cache with network_info: [{"id": "2730a429-8948-4303-8bba-ec78e215a242", "address": "fa:16:3e:da:27:de", "network": {"id": "67b207cc-b262-42b8-8f93-361fd48b7db6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-196588653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edbd7362f5e44004a7adeb21f40e8e38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730a429-89", "ovs_interfaceid": "2730a429-8948-4303-8bba-ec78e215a242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Releasing lock "refresh_cache-f5ba4305-b304-46d5-8069-37abab0e430d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Instance network_info: |[{"id": "2730a429-8948-4303-8bba-ec78e215a242", "address": "fa:16:3e:da:27:de", "network": {"id": "67b207cc-b262-42b8-8f93-361fd48b7db6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-196588653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edbd7362f5e44004a7adeb21f40e8e38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730a429-89", "ovs_interfaceid": "2730a429-8948-4303-8bba-ec78e215a242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b98f4bf8-e451-4adf-995d-387f9276ff4c req-4e82da81-a65f-4722-8553-848dd833cb19 service nova] Acquired lock "refresh_cache-f5ba4305-b304-46d5-8069-37abab0e430d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.network.neutron [req-b98f4bf8-e451-4adf-995d-387f9276ff4c req-4e82da81-a65f-4722-8553-848dd833cb19 service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Refreshing network info cache for port 2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Start _get_guest_xml network_info=[{"id": "2730a429-8948-4303-8bba-ec78e215a242", "address": "fa:16:3e:da:27:de", "network": {"id": "67b207cc-b262-42b8-8f93-361fd48b7db6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-196588653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edbd7362f5e44004a7adeb21f40e8e38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730a429-89", "ovs_interfaceid": "2730a429-8948-4303-8bba-ec78e215a242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:53:34 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:53:34 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-419428525',display_name='tempest-DeleteServersTestJSON-server-419428525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-419428525',id=1,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edbd7362f5e44004a7adeb21f40e8e38',ramdisk_id='',reservation_id='r-jil7xhhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1125585776',owner_user_name='tempest-DeleteServersTestJSON-1125585776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:53:26Z,user_data=None,user_id='81819d9f8bc24f19b0702d986df7cf70',uuid=f5ba4305-b304-46d5-8069-37abab0e430d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2730a429-8948-4303-8bba-ec78e215a242", "address": "fa:16:3e:da:27:de", "network": {"id": "67b207cc-b262-42b8-8f93-361fd48b7db6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-196588653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edbd7362f5e44004a7adeb21f40e8e38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730a429-89", "ovs_interfaceid": "2730a429-8948-4303-8bba-ec78e215a242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Converting VIF {"id": "2730a429-8948-4303-8bba-ec78e215a242", "address": "fa:16:3e:da:27:de", "network": {"id": "67b207cc-b262-42b8-8f93-361fd48b7db6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-196588653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edbd7362f5e44004a7adeb21f40e8e38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730a429-89", "ovs_interfaceid": "2730a429-8948-4303-8bba-ec78e215a242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:27:de,bridge_name='br-int',has_traffic_filtering=True,id=2730a429-8948-4303-8bba-ec78e215a242,network=Network(67b207cc-b262-42b8-8f93-361fd48b7db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2730a429-89') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lazy-loading 'pci_devices' on Instance uuid f5ba4305-b304-46d5-8069-37abab0e430d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:53:34 user nova-compute[72815]:   <uuid>f5ba4305-b304-46d5-8069-37abab0e430d</uuid>
Aug 17 19:53:34 user nova-compute[72815]:   <name>instance-00000001</name>
Aug 17 19:53:34 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:53:34 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:53:34 user nova-compute[72815]:   <metadata>
Aug 17 19:53:34 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:53:34 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:53:34 user nova-compute[72815]:       <nova:name>tempest-DeleteServersTestJSON-server-419428525</nova:name>
Aug 17 19:53:34 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:53:34</nova:creationTime>
Aug 17 19:53:34 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:53:34 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:53:34 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:53:34 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:53:34 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:53:34 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:53:34 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:53:34 user nova-compute[72815]:       <nova:owner>
Aug 17 19:53:34 user nova-compute[72815]:         <nova:user uuid="81819d9f8bc24f19b0702d986df7cf70">tempest-DeleteServersTestJSON-1125585776-project-member</nova:user>
Aug 17 19:53:34 user nova-compute[72815]:         <nova:project uuid="edbd7362f5e44004a7adeb21f40e8e38">tempest-DeleteServersTestJSON-1125585776</nova:project>
Aug 17 19:53:34 user nova-compute[72815]:       </nova:owner>
Aug 17 19:53:34 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:53:34 user nova-compute[72815]:       <nova:ports>
Aug 17 19:53:34 user nova-compute[72815]:         <nova:port uuid="2730a429-8948-4303-8bba-ec78e215a242">
Aug 17 19:53:34 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 19:53:34 user nova-compute[72815]:         </nova:port>
Aug 17 19:53:34 user nova-compute[72815]:       </nova:ports>
Aug 17 19:53:34 user nova-compute[72815]:     </nova:instance>
Aug 17 19:53:34 user nova-compute[72815]:   </metadata>
Aug 17 19:53:34 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:53:34 user nova-compute[72815]:     <system>
Aug 17 19:53:34 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:53:34 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:53:34 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:53:34 user nova-compute[72815]:       <entry name="serial">f5ba4305-b304-46d5-8069-37abab0e430d</entry>
Aug 17 19:53:34 user nova-compute[72815]:       <entry name="uuid">f5ba4305-b304-46d5-8069-37abab0e430d</entry>
Aug 17 19:53:34 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:53:34 user nova-compute[72815]:     </system>
Aug 17 19:53:34 user nova-compute[72815]:   </sysinfo>
Aug 17 19:53:34 user nova-compute[72815]:   <os>
Aug 17 19:53:34 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:53:34 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:53:34 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:53:34 user nova-compute[72815]:   </os>
Aug 17 19:53:34 user nova-compute[72815]:   <features>
Aug 17 19:53:34 user nova-compute[72815]:     <acpi/>
Aug 17 19:53:34 user nova-compute[72815]:     <apic/>
Aug 17 19:53:34 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:53:34 user nova-compute[72815]:   </features>
Aug 17 19:53:34 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:53:34 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:53:34 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:53:34 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:53:34 user nova-compute[72815]:   </clock>
Aug 17 19:53:34 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:53:34 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:53:34 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:53:34 user nova-compute[72815]:   </cpu>
Aug 17 19:53:34 user nova-compute[72815]:   <devices>
Aug 17 19:53:34 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:53:34 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:53:34 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk"/>
Aug 17 19:53:34 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:53:34 user nova-compute[72815]:     </disk>
Aug 17 19:53:34 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:53:34 user nova-compute[72815]:       <mac address="fa:16:3e:da:27:de"/>
Aug 17 19:53:34 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:53:34 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:53:34 user nova-compute[72815]:       <target dev="tap2730a429-89"/>
Aug 17 19:53:34 user nova-compute[72815]:     </interface>
Aug 17 19:53:34 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:53:34 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/console.log" append="off"/>
Aug 17 19:53:34 user nova-compute[72815]:     </serial>
Aug 17 19:53:34 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:53:34 user nova-compute[72815]:     <video>
Aug 17 19:53:34 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:53:34 user nova-compute[72815]:     </video>
Aug 17 19:53:34 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:53:34 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:53:34 user nova-compute[72815]:     </rng>
Aug 17 19:53:34 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:53:34 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:53:34 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:53:34 user nova-compute[72815]:     </memballoon>
Aug 17 19:53:34 user nova-compute[72815]:   </devices>
Aug 17 19:53:34 user nova-compute[72815]: </domain>
Aug 17 19:53:34 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-419428525',display_name='tempest-DeleteServersTestJSON-server-419428525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-419428525',id=1,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edbd7362f5e44004a7adeb21f40e8e38',ramdisk_id='',reservation_id='r-jil7xhhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1125585776',owner_user_name='tempest-DeleteServersTestJSON-1125585776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:53:26Z,user_data=None,user_id='81819d9f8bc24f19b0702d986df7cf70',uuid=f5ba4305-b304-46d5-8069-37abab0e430d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2730a429-8948-4303-8bba-ec78e215a242", "address": "fa:16:3e:da:27:de", "network": {"id": "67b207cc-b262-42b8-8f93-361fd48b7db6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-196588653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edbd7362f5e44004a7adeb21f40e8e38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730a429-89", "ovs_interfaceid": "2730a429-8948-4303-8bba-ec78e215a242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Converting VIF {"id": "2730a429-8948-4303-8bba-ec78e215a242", "address": "fa:16:3e:da:27:de", "network": {"id": "67b207cc-b262-42b8-8f93-361fd48b7db6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-196588653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edbd7362f5e44004a7adeb21f40e8e38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730a429-89", "ovs_interfaceid": "2730a429-8948-4303-8bba-ec78e215a242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:27:de,bridge_name='br-int',has_traffic_filtering=True,id=2730a429-8948-4303-8bba-ec78e215a242,network=Network(67b207cc-b262-42b8-8f93-361fd48b7db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2730a429-89') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:53:34 user nova-compute[72815]: DEBUG os_vif [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:27:de,bridge_name='br-int',has_traffic_filtering=True,id=2730a429-8948-4303-8bba-ec78e215a242,network=Network(67b207cc-b262-42b8-8f93-361fd48b7db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2730a429-89') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Created schema index Interface.name {{(pid=72815) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Created schema index Port.name {{(pid=72815) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Created schema index Bridge.name {{(pid=72815) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [POLLOUT] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:53:35 user nova-compute[72815]: INFO oslo.privsep.daemon [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmph23dvtyu/privsep.sock']
Aug 17 19:53:35 user sudo[82159]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmph23dvtyu/privsep.sock
Aug 17 19:53:35 user sudo[82159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Successfully updated port: 0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquired lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Successfully created port: d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:53:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:36 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:53:36 user nova-compute[72815]: DEBUG nova.compute.manager [req-149a95a0-1dbb-4783-a650-0a55e4fadebf req-d518dd4f-3065-4577-91b0-b59336be1f6f service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Received event network-changed-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:53:36 user nova-compute[72815]: DEBUG nova.compute.manager [req-149a95a0-1dbb-4783-a650-0a55e4fadebf req-d518dd4f-3065-4577-91b0-b59336be1f6f service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Refreshing instance network info cache due to event network-changed-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:53:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-149a95a0-1dbb-4783-a650-0a55e4fadebf req-d518dd4f-3065-4577-91b0-b59336be1f6f service nova] Acquiring lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:53:36 user sudo[82159]: pam_unix(sudo:session): session closed for user root
Aug 17 19:53:36 user nova-compute[72815]: INFO oslo.privsep.daemon [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Spawned new privsep daemon via rootwrap
Aug 17 19:53:36 user nova-compute[72815]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 19:53:36 user nova-compute[72815]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 19:53:36 user nova-compute[72815]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 17 19:53:36 user nova-compute[72815]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82162
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Successfully updated port: d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquired lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2730a429-89, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2730a429-89, col_values=(('external_ids', {'iface-id': '2730a429-8948-4303-8bba-ec78e215a242', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:27:de', 'vm-uuid': 'f5ba4305-b304-46d5-8069-37abab0e430d'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:37 user nova-compute[72815]: INFO os_vif [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:27:de,bridge_name='br-int',has_traffic_filtering=True,id=2730a429-8948-4303-8bba-ec78e215a242,network=Network(67b207cc-b262-42b8-8f93-361fd48b7db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2730a429-89')
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] No VIF found with MAC fa:16:3e:da:27:de, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.network.neutron [req-b98f4bf8-e451-4adf-995d-387f9276ff4c req-4e82da81-a65f-4722-8553-848dd833cb19 service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Updated VIF entry in instance network info cache for port 2730a429-8948-4303-8bba-ec78e215a242. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.network.neutron [req-b98f4bf8-e451-4adf-995d-387f9276ff4c req-4e82da81-a65f-4722-8553-848dd833cb19 service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Updating instance_info_cache with network_info: [{"id": "2730a429-8948-4303-8bba-ec78e215a242", "address": "fa:16:3e:da:27:de", "network": {"id": "67b207cc-b262-42b8-8f93-361fd48b7db6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-196588653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edbd7362f5e44004a7adeb21f40e8e38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730a429-89", "ovs_interfaceid": "2730a429-8948-4303-8bba-ec78e215a242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b98f4bf8-e451-4adf-995d-387f9276ff4c req-4e82da81-a65f-4722-8553-848dd833cb19 service nova] Releasing lock "refresh_cache-f5ba4305-b304-46d5-8069-37abab0e430d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:53:37 user nova-compute[72815]: INFO nova.compute.claims [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Claim successful on node user
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.compute.manager [req-f7347ab3-5b94-4d63-836d-928ec6a0f1d8 req-8a93dffd-2fa5-487a-aefb-5e531a646524 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Received event network-changed-d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.compute.manager [req-f7347ab3-5b94-4d63-836d-928ec6a0f1d8 req-8a93dffd-2fa5-487a-aefb-5e531a646524 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Refreshing instance network info cache due to event network-changed-d049d487-388c-408b-ada5-ae68e86585c3. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f7347ab3-5b94-4d63-836d-928ec6a0f1d8 req-8a93dffd-2fa5-487a-aefb-5e531a646524 service nova] Acquiring lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Updating instance_info_cache with network_info: [{"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Releasing lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Instance network_info: |[{"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-149a95a0-1dbb-4783-a650-0a55e4fadebf req-d518dd4f-3065-4577-91b0-b59336be1f6f service nova] Acquired lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.network.neutron [req-149a95a0-1dbb-4783-a650-0a55e4fadebf req-d518dd4f-3065-4577-91b0-b59336be1f6f service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Refreshing network info cache for port 0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Start _get_guest_xml network_info=[{"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:53:37 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:53:37 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2026223806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2026223806',id=2,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-ur7p6puv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:53:29Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=1a714bfa-0b06-4ef8-865a-819abbc64be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:de:83,bridge_name='br-int',has_traffic_filtering=True,id=0bdd8475-7ec8-4f5c-83ae-37ffa791a57c,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bdd8475-7e') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a714bfa-0b06-4ef8-865a-819abbc64be5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:53:37 user nova-compute[72815]:   <uuid>1a714bfa-0b06-4ef8-865a-819abbc64be5</uuid>
Aug 17 19:53:37 user nova-compute[72815]:   <name>instance-00000002</name>
Aug 17 19:53:37 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:53:37 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:53:37 user nova-compute[72815]:   <metadata>
Aug 17 19:53:37 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:53:37 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:53:37 user nova-compute[72815]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2026223806</nova:name>
Aug 17 19:53:37 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:53:37</nova:creationTime>
Aug 17 19:53:37 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:53:37 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:53:37 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:53:37 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:53:37 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:53:37 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:53:37 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:53:37 user nova-compute[72815]:       <nova:owner>
Aug 17 19:53:37 user nova-compute[72815]:         <nova:user uuid="169121564e514d4f883b71abeb3e6070">tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member</nova:user>
Aug 17 19:53:37 user nova-compute[72815]:         <nova:project uuid="89c20bd5232b4b058abc1b50f38cade3">tempest-ServerBootFromVolumeStableRescueTest-264619992</nova:project>
Aug 17 19:53:37 user nova-compute[72815]:       </nova:owner>
Aug 17 19:53:37 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:53:37 user nova-compute[72815]:       <nova:ports>
Aug 17 19:53:37 user nova-compute[72815]:         <nova:port uuid="0bdd8475-7ec8-4f5c-83ae-37ffa791a57c">
Aug 17 19:53:37 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 19:53:37 user nova-compute[72815]:         </nova:port>
Aug 17 19:53:37 user nova-compute[72815]:       </nova:ports>
Aug 17 19:53:37 user nova-compute[72815]:     </nova:instance>
Aug 17 19:53:37 user nova-compute[72815]:   </metadata>
Aug 17 19:53:37 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:53:37 user nova-compute[72815]:     <system>
Aug 17 19:53:37 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:53:37 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:53:37 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:53:37 user nova-compute[72815]:       <entry name="serial">1a714bfa-0b06-4ef8-865a-819abbc64be5</entry>
Aug 17 19:53:37 user nova-compute[72815]:       <entry name="uuid">1a714bfa-0b06-4ef8-865a-819abbc64be5</entry>
Aug 17 19:53:37 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:53:37 user nova-compute[72815]:     </system>
Aug 17 19:53:37 user nova-compute[72815]:   </sysinfo>
Aug 17 19:53:37 user nova-compute[72815]:   <os>
Aug 17 19:53:37 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:53:37 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:53:37 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:53:37 user nova-compute[72815]:   </os>
Aug 17 19:53:37 user nova-compute[72815]:   <features>
Aug 17 19:53:37 user nova-compute[72815]:     <acpi/>
Aug 17 19:53:37 user nova-compute[72815]:     <apic/>
Aug 17 19:53:37 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:53:37 user nova-compute[72815]:   </features>
Aug 17 19:53:37 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:53:37 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:53:37 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:53:37 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:53:37 user nova-compute[72815]:   </clock>
Aug 17 19:53:37 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:53:37 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:53:37 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:53:37 user nova-compute[72815]:   </cpu>
Aug 17 19:53:37 user nova-compute[72815]:   <devices>
Aug 17 19:53:37 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:53:37 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:53:37 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk"/>
Aug 17 19:53:37 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:53:37 user nova-compute[72815]:     </disk>
Aug 17 19:53:37 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:53:37 user nova-compute[72815]:       <mac address="fa:16:3e:60:de:83"/>
Aug 17 19:53:37 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:53:37 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:53:37 user nova-compute[72815]:       <target dev="tap0bdd8475-7e"/>
Aug 17 19:53:37 user nova-compute[72815]:     </interface>
Aug 17 19:53:37 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:53:37 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/console.log" append="off"/>
Aug 17 19:53:37 user nova-compute[72815]:     </serial>
Aug 17 19:53:37 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:53:37 user nova-compute[72815]:     <video>
Aug 17 19:53:37 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:53:37 user nova-compute[72815]:     </video>
Aug 17 19:53:37 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:53:37 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:53:37 user nova-compute[72815]:     </rng>
Aug 17 19:53:37 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:53:37 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:53:37 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:53:37 user nova-compute[72815]:     </memballoon>
Aug 17 19:53:37 user nova-compute[72815]:   </devices>
Aug 17 19:53:37 user nova-compute[72815]: </domain>
Aug 17 19:53:37 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2026223806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2026223806',id=2,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-ur7p6puv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:53:29Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=1a714bfa-0b06-4ef8-865a-819abbc64be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:de:83,bridge_name='br-int',has_traffic_filtering=True,id=0bdd8475-7ec8-4f5c-83ae-37ffa791a57c,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bdd8475-7e') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG os_vif [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:de:83,bridge_name='br-int',has_traffic_filtering=True,id=0bdd8475-7ec8-4f5c-83ae-37ffa791a57c,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bdd8475-7e') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:53:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bdd8475-7e, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0bdd8475-7e, col_values=(('external_ids', {'iface-id': '0bdd8475-7ec8-4f5c-83ae-37ffa791a57c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:de:83', 'vm-uuid': '1a714bfa-0b06-4ef8-865a-819abbc64be5'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:38 user nova-compute[72815]: INFO os_vif [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:de:83,bridge_name='br-int',has_traffic_filtering=True,id=0bdd8475-7ec8-4f5c-83ae-37ffa791a57c,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bdd8475-7e')
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:38 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No VIF found with MAC fa:16:3e:60:de:83, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:53:38 user nova-compute[72815]: INFO nova.compute.claims [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Claim successful on node user
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:53:38 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Creating image(s)
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "/opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "/opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "/opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updating instance_info_cache with network_info: [{"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Releasing lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Instance network_info: |[{"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f7347ab3-5b94-4d63-836d-928ec6a0f1d8 req-8a93dffd-2fa5-487a-aefb-5e531a646524 service nova] Acquired lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.network.neutron [req-f7347ab3-5b94-4d63-836d-928ec6a0f1d8 req-8a93dffd-2fa5-487a-aefb-5e531a646524 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Refreshing network info cache for port d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Start _get_guest_xml network_info=[{"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:53:38 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:53:38 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1794052344',display_name='tempest-ServerActionsTestOtherA-server-1794052344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1794052344',id=3,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4ENuaMW9sQVv3tRQvGXO2rdSecjVcsBbTS05/ZUuaQNEEpkOe2HF0EHrSzQ0+4hhL3IgPXmkF5ZxUJ6bIwwpVvvT5kiu8Xp5gaO6UacRTK/fZorahpTHXq4z54fcfMBQ==',key_name='tempest-keypair-1973140313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-iv78cz1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=ab784398-43df-4214-bdd3-22c652ac710f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5f:47,bridge_name='br-int',has_traffic_filtering=True,id=d049d487-388c-408b-ada5-ae68e86585c3,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd049d487-38') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.objects.instance [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'pci_devices' on Instance uuid ab784398-43df-4214-bdd3-22c652ac710f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:53:38 user nova-compute[72815]:   <uuid>ab784398-43df-4214-bdd3-22c652ac710f</uuid>
Aug 17 19:53:38 user nova-compute[72815]:   <name>instance-00000003</name>
Aug 17 19:53:38 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:53:38 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:53:38 user nova-compute[72815]:   <metadata>
Aug 17 19:53:38 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:53:38 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:53:38 user nova-compute[72815]:       <nova:name>tempest-ServerActionsTestOtherA-server-1794052344</nova:name>
Aug 17 19:53:38 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:53:38</nova:creationTime>
Aug 17 19:53:38 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:53:38 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:53:38 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:53:38 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:53:38 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:53:38 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:53:38 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:53:38 user nova-compute[72815]:       <nova:owner>
Aug 17 19:53:38 user nova-compute[72815]:         <nova:user uuid="9821282c73174c448f7fca6b65676f61">tempest-ServerActionsTestOtherA-629489909-project-member</nova:user>
Aug 17 19:53:38 user nova-compute[72815]:         <nova:project uuid="a0708d4f49ed4c96b108d1d2aff76871">tempest-ServerActionsTestOtherA-629489909</nova:project>
Aug 17 19:53:38 user nova-compute[72815]:       </nova:owner>
Aug 17 19:53:38 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:53:38 user nova-compute[72815]:       <nova:ports>
Aug 17 19:53:38 user nova-compute[72815]:         <nova:port uuid="d049d487-388c-408b-ada5-ae68e86585c3">
Aug 17 19:53:38 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 19:53:38 user nova-compute[72815]:         </nova:port>
Aug 17 19:53:38 user nova-compute[72815]:       </nova:ports>
Aug 17 19:53:38 user nova-compute[72815]:     </nova:instance>
Aug 17 19:53:38 user nova-compute[72815]:   </metadata>
Aug 17 19:53:38 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:53:38 user nova-compute[72815]:     <system>
Aug 17 19:53:38 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:53:38 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:53:38 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:53:38 user nova-compute[72815]:       <entry name="serial">ab784398-43df-4214-bdd3-22c652ac710f</entry>
Aug 17 19:53:38 user nova-compute[72815]:       <entry name="uuid">ab784398-43df-4214-bdd3-22c652ac710f</entry>
Aug 17 19:53:38 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:53:38 user nova-compute[72815]:     </system>
Aug 17 19:53:38 user nova-compute[72815]:   </sysinfo>
Aug 17 19:53:38 user nova-compute[72815]:   <os>
Aug 17 19:53:38 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:53:38 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:53:38 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:53:38 user nova-compute[72815]:   </os>
Aug 17 19:53:38 user nova-compute[72815]:   <features>
Aug 17 19:53:38 user nova-compute[72815]:     <acpi/>
Aug 17 19:53:38 user nova-compute[72815]:     <apic/>
Aug 17 19:53:38 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:53:38 user nova-compute[72815]:   </features>
Aug 17 19:53:38 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:53:38 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:53:38 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:53:38 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:53:38 user nova-compute[72815]:   </clock>
Aug 17 19:53:38 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:53:38 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:53:38 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:53:38 user nova-compute[72815]:   </cpu>
Aug 17 19:53:38 user nova-compute[72815]:   <devices>
Aug 17 19:53:38 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:53:38 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:53:38 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk"/>
Aug 17 19:53:38 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:53:38 user nova-compute[72815]:     </disk>
Aug 17 19:53:38 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:53:38 user nova-compute[72815]:       <mac address="fa:16:3e:a0:5f:47"/>
Aug 17 19:53:38 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:53:38 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:53:38 user nova-compute[72815]:       <target dev="tapd049d487-38"/>
Aug 17 19:53:38 user nova-compute[72815]:     </interface>
Aug 17 19:53:38 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:53:38 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/console.log" append="off"/>
Aug 17 19:53:38 user nova-compute[72815]:     </serial>
Aug 17 19:53:38 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:53:38 user nova-compute[72815]:     <video>
Aug 17 19:53:38 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:53:38 user nova-compute[72815]:     </video>
Aug 17 19:53:38 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:53:38 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:53:38 user nova-compute[72815]:     </rng>
Aug 17 19:53:38 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:53:38 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:53:38 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:53:38 user nova-compute[72815]:     </memballoon>
Aug 17 19:53:38 user nova-compute[72815]:   </devices>
Aug 17 19:53:38 user nova-compute[72815]: </domain>
Aug 17 19:53:38 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1794052344',display_name='tempest-ServerActionsTestOtherA-server-1794052344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1794052344',id=3,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4ENuaMW9sQVv3tRQvGXO2rdSecjVcsBbTS05/ZUuaQNEEpkOe2HF0EHrSzQ0+4hhL3IgPXmkF5ZxUJ6bIwwpVvvT5kiu8Xp5gaO6UacRTK/fZorahpTHXq4z54fcfMBQ==',key_name='tempest-keypair-1973140313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-iv78cz1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=ab784398-43df-4214-bdd3-22c652ac710f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5f:47,bridge_name='br-int',has_traffic_filtering=True,id=d049d487-388c-408b-ada5-ae68e86585c3,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd049d487-38') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG os_vif [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5f:47,bridge_name='br-int',has_traffic_filtering=True,id=d049d487-388c-408b-ada5-ae68e86585c3,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd049d487-38') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd049d487-38, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd049d487-38, col_values=(('external_ids', {'iface-id': 'd049d487-388c-408b-ada5-ae68e86585c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:5f:47', 'vm-uuid': 'ab784398-43df-4214-bdd3-22c652ac710f'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.191s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:38 user nova-compute[72815]: INFO os_vif [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5f:47,bridge_name='br-int',has_traffic_filtering=True,id=d049d487-388c-408b-ada5-ae68e86585c3,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd049d487-38')
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.policy [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c83afcb788d541d1a3f8c75e5a39c6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85a305cdf974d10a935caff8ccec9b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No VIF found with MAC fa:16:3e:a0:5f:47, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.239s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk 1073741824" returned: 0 in 0.069s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:38 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:53:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.167s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:53:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Creating image(s)
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "/opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "/opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "/opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.policy [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c894534b34d943229dc89f6d58836acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb016b8ab299475e9f916809c7b55182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Cannot resize image /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'migration_context' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Ensure instance console log exists: /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.226s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk 1073741824" returned: 0 in 0.049s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.178s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.network.neutron [req-f7347ab3-5b94-4d63-836d-928ec6a0f1d8 req-8a93dffd-2fa5-487a-aefb-5e531a646524 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updated VIF entry in instance network info cache for port d049d487-388c-408b-ada5-ae68e86585c3. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.network.neutron [req-f7347ab3-5b94-4d63-836d-928ec6a0f1d8 req-8a93dffd-2fa5-487a-aefb-5e531a646524 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updating instance_info_cache with network_info: [{"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f7347ab3-5b94-4d63-836d-928ec6a0f1d8 req-8a93dffd-2fa5-487a-aefb-5e531a646524 service nova] Releasing lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Cannot resize image /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'migration_context' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Ensure instance console log exists: /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.network.neutron [req-149a95a0-1dbb-4783-a650-0a55e4fadebf req-d518dd4f-3065-4577-91b0-b59336be1f6f service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Updated VIF entry in instance network info cache for port 0bdd8475-7ec8-4f5c-83ae-37ffa791a57c. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG nova.network.neutron [req-149a95a0-1dbb-4783-a650-0a55e4fadebf req-d518dd4f-3065-4577-91b0-b59336be1f6f service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Updating instance_info_cache with network_info: [{"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:53:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-149a95a0-1dbb-4783-a650-0a55e4fadebf req-d518dd4f-3065-4577-91b0-b59336be1f6f service nova] Releasing lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:53:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:40 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Successfully created port: 7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:53:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Successfully created port: 991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:53:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:42 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Successfully updated port: 7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:53:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:53:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquired lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:53:42 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:53:42 user nova-compute[72815]: DEBUG nova.compute.manager [req-594d9bed-6604-48df-a5d4-67e3e0dcd825 req-95de8c13-9638-4661-990f-c7b08ca2552f service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-changed-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:53:42 user nova-compute[72815]: DEBUG nova.compute.manager [req-594d9bed-6604-48df-a5d4-67e3e0dcd825 req-95de8c13-9638-4661-990f-c7b08ca2552f service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Refreshing instance network info cache due to event network-changed-7d010d95-173c-44df-be70-170e3ca59b0e. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:53:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-594d9bed-6604-48df-a5d4-67e3e0dcd825 req-95de8c13-9638-4661-990f-c7b08ca2552f service nova] Acquiring lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:53:42 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Updating instance_info_cache with network_info: [{"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Releasing lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance network_info: |[{"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-594d9bed-6604-48df-a5d4-67e3e0dcd825 req-95de8c13-9638-4661-990f-c7b08ca2552f service nova] Acquired lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.network.neutron [req-594d9bed-6604-48df-a5d4-67e3e0dcd825 req-95de8c13-9638-4661-990f-c7b08ca2552f service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Refreshing network info cache for port 7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Start _get_guest_xml network_info=[{"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:53:43 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:53:43 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643279889',display_name='tempest-AttachVolumeTestJSON-server-643279889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643279889',id=5,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESF266QwfIKeTik8wnoygIiOf2r6BrCWxIIzDojrbBZKm/zXPBtL9YHLKhpKFS8eHXyHAtcWfIKVJD6LLHKDkJll+G0nOWdMGtF8im19Z7tm6u5x2HPboD1YjRBA8g36A==',key_name='tempest-keypair-447370262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb016b8ab299475e9f916809c7b55182',ramdisk_id='',reservation_id='r-0ehl5jun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1462912324',owner_user_name='tempest-AttachVolumeTestJSON-1462912324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c894534b34d943229dc89f6d58836acb',uuid=1800ab7b-dd88-45fb-9370-1b77b8cbf893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converting VIF {"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'pci_devices' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:53:43 user nova-compute[72815]:   <uuid>1800ab7b-dd88-45fb-9370-1b77b8cbf893</uuid>
Aug 17 19:53:43 user nova-compute[72815]:   <name>instance-00000005</name>
Aug 17 19:53:43 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:53:43 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:53:43 user nova-compute[72815]:   <metadata>
Aug 17 19:53:43 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:53:43 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:53:43 user nova-compute[72815]:       <nova:name>tempest-AttachVolumeTestJSON-server-643279889</nova:name>
Aug 17 19:53:43 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:53:43</nova:creationTime>
Aug 17 19:53:43 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:53:43 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:53:43 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:53:43 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:53:43 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:53:43 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:53:43 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:53:43 user nova-compute[72815]:       <nova:owner>
Aug 17 19:53:43 user nova-compute[72815]:         <nova:user uuid="c894534b34d943229dc89f6d58836acb">tempest-AttachVolumeTestJSON-1462912324-project-member</nova:user>
Aug 17 19:53:43 user nova-compute[72815]:         <nova:project uuid="fb016b8ab299475e9f916809c7b55182">tempest-AttachVolumeTestJSON-1462912324</nova:project>
Aug 17 19:53:43 user nova-compute[72815]:       </nova:owner>
Aug 17 19:53:43 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:53:43 user nova-compute[72815]:       <nova:ports>
Aug 17 19:53:43 user nova-compute[72815]:         <nova:port uuid="7d010d95-173c-44df-be70-170e3ca59b0e">
Aug 17 19:53:43 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 19:53:43 user nova-compute[72815]:         </nova:port>
Aug 17 19:53:43 user nova-compute[72815]:       </nova:ports>
Aug 17 19:53:43 user nova-compute[72815]:     </nova:instance>
Aug 17 19:53:43 user nova-compute[72815]:   </metadata>
Aug 17 19:53:43 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:53:43 user nova-compute[72815]:     <system>
Aug 17 19:53:43 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:53:43 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:53:43 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:53:43 user nova-compute[72815]:       <entry name="serial">1800ab7b-dd88-45fb-9370-1b77b8cbf893</entry>
Aug 17 19:53:43 user nova-compute[72815]:       <entry name="uuid">1800ab7b-dd88-45fb-9370-1b77b8cbf893</entry>
Aug 17 19:53:43 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:53:43 user nova-compute[72815]:     </system>
Aug 17 19:53:43 user nova-compute[72815]:   </sysinfo>
Aug 17 19:53:43 user nova-compute[72815]:   <os>
Aug 17 19:53:43 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:53:43 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:53:43 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:53:43 user nova-compute[72815]:   </os>
Aug 17 19:53:43 user nova-compute[72815]:   <features>
Aug 17 19:53:43 user nova-compute[72815]:     <acpi/>
Aug 17 19:53:43 user nova-compute[72815]:     <apic/>
Aug 17 19:53:43 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:53:43 user nova-compute[72815]:   </features>
Aug 17 19:53:43 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:53:43 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:53:43 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:53:43 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:53:43 user nova-compute[72815]:   </clock>
Aug 17 19:53:43 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:53:43 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:53:43 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:53:43 user nova-compute[72815]:   </cpu>
Aug 17 19:53:43 user nova-compute[72815]:   <devices>
Aug 17 19:53:43 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:53:43 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:53:43 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk"/>
Aug 17 19:53:43 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:53:43 user nova-compute[72815]:     </disk>
Aug 17 19:53:43 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:53:43 user nova-compute[72815]:       <mac address="fa:16:3e:ef:cb:33"/>
Aug 17 19:53:43 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:53:43 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:53:43 user nova-compute[72815]:       <target dev="tap7d010d95-17"/>
Aug 17 19:53:43 user nova-compute[72815]:     </interface>
Aug 17 19:53:43 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:53:43 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/console.log" append="off"/>
Aug 17 19:53:43 user nova-compute[72815]:     </serial>
Aug 17 19:53:43 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:53:43 user nova-compute[72815]:     <video>
Aug 17 19:53:43 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:53:43 user nova-compute[72815]:     </video>
Aug 17 19:53:43 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:53:43 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:53:43 user nova-compute[72815]:     </rng>
Aug 17 19:53:43 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:53:43 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:53:43 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:53:43 user nova-compute[72815]:     </memballoon>
Aug 17 19:53:43 user nova-compute[72815]:   </devices>
Aug 17 19:53:43 user nova-compute[72815]: </domain>
Aug 17 19:53:43 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643279889',display_name='tempest-AttachVolumeTestJSON-server-643279889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643279889',id=5,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESF266QwfIKeTik8wnoygIiOf2r6BrCWxIIzDojrbBZKm/zXPBtL9YHLKhpKFS8eHXyHAtcWfIKVJD6LLHKDkJll+G0nOWdMGtF8im19Z7tm6u5x2HPboD1YjRBA8g36A==',key_name='tempest-keypair-447370262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb016b8ab299475e9f916809c7b55182',ramdisk_id='',reservation_id='r-0ehl5jun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1462912324',owner_user_name='tempest-AttachVolumeTestJSON-1462912324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c894534b34d943229dc89f6d58836acb',uuid=1800ab7b-dd88-45fb-9370-1b77b8cbf893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converting VIF {"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG os_vif [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d010d95-17, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d010d95-17, col_values=(('external_ids', {'iface-id': '7d010d95-173c-44df-be70-170e3ca59b0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:cb:33', 'vm-uuid': '1800ab7b-dd88-45fb-9370-1b77b8cbf893'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:43 user nova-compute[72815]: INFO os_vif [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17')
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No VIF found with MAC fa:16:3e:ef:cb:33, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302023.622479, 1a714bfa-0b06-4ef8-865a-819abbc64be5 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:53:43 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] VM Resumed (Lifecycle Event)
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:53:43 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Instance spawned successfully.
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:53:43 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Instance spawned successfully.
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:53:43 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Instance spawned successfully.
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:53:43 user nova-compute[72815]: INFO nova.compute.manager [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Took 10.14 seconds to spawn the instance on the hypervisor.
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:43 user nova-compute[72815]: INFO nova.compute.manager [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Took 14.99 seconds to spawn the instance on the hypervisor.
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:43 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:53:43 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302023.62267, 1a714bfa-0b06-4ef8-865a-819abbc64be5 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:53:43 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] VM Started (Lifecycle Event)
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Successfully updated port: 991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:53:44 user nova-compute[72815]: INFO nova.compute.manager [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Took 11.01 seconds to build instance.
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:44 user nova-compute[72815]: INFO nova.compute.manager [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Took 18.27 seconds to spawn the instance on the hypervisor.
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquired lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:53:44 user nova-compute[72815]: INFO nova.compute.manager [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Took 16.09 seconds to build instance.
Aug 17 19:53:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d43cfaf0-3df0-4455-accf-0268a5263076 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "ab784398-43df-4214-bdd3-22c652ac710f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.284s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302023.6815033, ab784398-43df-4214-bdd3-22c652ac710f => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:53:44 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] VM Resumed (Lifecycle Event)
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-cb58dca9-d835-4479-acb2-0ca87e5c9a59 req-c0aa67c9-2f29-4c81-a5e1-15f051109ad3 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-changed-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-cb58dca9-d835-4479-acb2-0ca87e5c9a59 req-c0aa67c9-2f29-4c81-a5e1-15f051109ad3 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Refreshing instance network info cache due to event network-changed-991f5622-2c12-4ea1-950b-19b55e89c57c. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cb58dca9-d835-4479-acb2-0ca87e5c9a59 req-c0aa67c9-2f29-4c81-a5e1-15f051109ad3 service nova] Acquiring lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2fb10c80-3e0a-4eec-a7ff-2c7f1879cc3f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.277s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:44 user nova-compute[72815]: INFO nova.compute.manager [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Took 19.29 seconds to build instance.
Aug 17 19:53:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6e93151a-1cb8-4e09-9062-4422ca30d179 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "f5ba4305-b304-46d5-8069-37abab0e430d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.539s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302023.6826236, ab784398-43df-4214-bdd3-22c652ac710f => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:53:44 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] VM Started (Lifecycle Event)
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302023.8025784, f5ba4305-b304-46d5-8069-37abab0e430d => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:53:44 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] VM Resumed (Lifecycle Event)
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.network.neutron [req-594d9bed-6604-48df-a5d4-67e3e0dcd825 req-95de8c13-9638-4661-990f-c7b08ca2552f service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Updated VIF entry in instance network info cache for port 7d010d95-173c-44df-be70-170e3ca59b0e. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.network.neutron [req-594d9bed-6604-48df-a5d4-67e3e0dcd825 req-95de8c13-9638-4661-990f-c7b08ca2552f service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Updating instance_info_cache with network_info: [{"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302023.8028195, f5ba4305-b304-46d5-8069-37abab0e430d => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:53:44 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] VM Started (Lifecycle Event)
Aug 17 19:53:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-594d9bed-6604-48df-a5d4-67e3e0dcd825 req-95de8c13-9638-4661-990f-c7b08ca2552f service nova] Releasing lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updating instance_info_cache with network_info: [{"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Releasing lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Instance network_info: |[{"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cb58dca9-d835-4479-acb2-0ca87e5c9a59 req-c0aa67c9-2f29-4c81-a5e1-15f051109ad3 service nova] Acquired lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.network.neutron [req-cb58dca9-d835-4479-acb2-0ca87e5c9a59 req-c0aa67c9-2f29-4c81-a5e1-15f051109ad3 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Refreshing network info cache for port 991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Start _get_guest_xml network_info=[{"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:53:46 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:53:46 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-17342816',display_name='tempest-ServerStableDeviceRescueTest-server-17342816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-17342816',id=4,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJrunJLrimEM+Gxd+hZ0sJyZLFWCB51uwbX7BQYwnQxoGyp8d2DETwVwLuci+7ubf+bNZxthaOWRg3z6FnbUfc/e9ggUpquvSY1IwPjdo3Nh8aVScHbxFmWLdJGFJkMXQ==',key_name='tempest-keypair-1184284913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b85a305cdf974d10a935caff8ccec9b4',ramdisk_id='',reservation_id='r-bm8bw4wj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-344410182',owner_user_name='tempest-ServerStableDeviceRescueTest-344410182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:53:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c83afcb788d541d1a3f8c75e5a39c6ce',uuid=07d46763-1b59-4cce-9e10-e94d0efea05d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Converting VIF {"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:1e:21,bridge_name='br-int',has_traffic_filtering=True,id=991f5622-2c12-4ea1-950b-19b55e89c57c,network=Network(557c4953-b996-4cb6-8b45-a1ca6ec545f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991f5622-2c') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'pci_devices' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:53:46 user nova-compute[72815]:   <uuid>07d46763-1b59-4cce-9e10-e94d0efea05d</uuid>
Aug 17 19:53:46 user nova-compute[72815]:   <name>instance-00000004</name>
Aug 17 19:53:46 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:53:46 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:53:46 user nova-compute[72815]:   <metadata>
Aug 17 19:53:46 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:53:46 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:53:46 user nova-compute[72815]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-17342816</nova:name>
Aug 17 19:53:46 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:53:46</nova:creationTime>
Aug 17 19:53:46 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:53:46 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:53:46 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:53:46 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:53:46 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:53:46 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:53:46 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:53:46 user nova-compute[72815]:       <nova:owner>
Aug 17 19:53:46 user nova-compute[72815]:         <nova:user uuid="c83afcb788d541d1a3f8c75e5a39c6ce">tempest-ServerStableDeviceRescueTest-344410182-project-member</nova:user>
Aug 17 19:53:46 user nova-compute[72815]:         <nova:project uuid="b85a305cdf974d10a935caff8ccec9b4">tempest-ServerStableDeviceRescueTest-344410182</nova:project>
Aug 17 19:53:46 user nova-compute[72815]:       </nova:owner>
Aug 17 19:53:46 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:53:46 user nova-compute[72815]:       <nova:ports>
Aug 17 19:53:46 user nova-compute[72815]:         <nova:port uuid="991f5622-2c12-4ea1-950b-19b55e89c57c">
Aug 17 19:53:46 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 19:53:46 user nova-compute[72815]:         </nova:port>
Aug 17 19:53:46 user nova-compute[72815]:       </nova:ports>
Aug 17 19:53:46 user nova-compute[72815]:     </nova:instance>
Aug 17 19:53:46 user nova-compute[72815]:   </metadata>
Aug 17 19:53:46 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:53:46 user nova-compute[72815]:     <system>
Aug 17 19:53:46 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:53:46 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:53:46 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:53:46 user nova-compute[72815]:       <entry name="serial">07d46763-1b59-4cce-9e10-e94d0efea05d</entry>
Aug 17 19:53:46 user nova-compute[72815]:       <entry name="uuid">07d46763-1b59-4cce-9e10-e94d0efea05d</entry>
Aug 17 19:53:46 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:53:46 user nova-compute[72815]:     </system>
Aug 17 19:53:46 user nova-compute[72815]:   </sysinfo>
Aug 17 19:53:46 user nova-compute[72815]:   <os>
Aug 17 19:53:46 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:53:46 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:53:46 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:53:46 user nova-compute[72815]:   </os>
Aug 17 19:53:46 user nova-compute[72815]:   <features>
Aug 17 19:53:46 user nova-compute[72815]:     <acpi/>
Aug 17 19:53:46 user nova-compute[72815]:     <apic/>
Aug 17 19:53:46 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:53:46 user nova-compute[72815]:   </features>
Aug 17 19:53:46 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:53:46 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:53:46 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:53:46 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:53:46 user nova-compute[72815]:   </clock>
Aug 17 19:53:46 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:53:46 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:53:46 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:53:46 user nova-compute[72815]:   </cpu>
Aug 17 19:53:46 user nova-compute[72815]:   <devices>
Aug 17 19:53:46 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:53:46 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:53:46 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk"/>
Aug 17 19:53:46 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:53:46 user nova-compute[72815]:     </disk>
Aug 17 19:53:46 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:53:46 user nova-compute[72815]:       <mac address="fa:16:3e:38:1e:21"/>
Aug 17 19:53:46 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:53:46 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:53:46 user nova-compute[72815]:       <target dev="tap991f5622-2c"/>
Aug 17 19:53:46 user nova-compute[72815]:     </interface>
Aug 17 19:53:46 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:53:46 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/console.log" append="off"/>
Aug 17 19:53:46 user nova-compute[72815]:     </serial>
Aug 17 19:53:46 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:53:46 user nova-compute[72815]:     <video>
Aug 17 19:53:46 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:53:46 user nova-compute[72815]:     </video>
Aug 17 19:53:46 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:53:46 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:53:46 user nova-compute[72815]:     </rng>
Aug 17 19:53:46 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:53:46 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:53:46 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:53:46 user nova-compute[72815]:     </memballoon>
Aug 17 19:53:46 user nova-compute[72815]:   </devices>
Aug 17 19:53:46 user nova-compute[72815]: </domain>
Aug 17 19:53:46 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-17342816',display_name='tempest-ServerStableDeviceRescueTest-server-17342816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-17342816',id=4,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJrunJLrimEM+Gxd+hZ0sJyZLFWCB51uwbX7BQYwnQxoGyp8d2DETwVwLuci+7ubf+bNZxthaOWRg3z6FnbUfc/e9ggUpquvSY1IwPjdo3Nh8aVScHbxFmWLdJGFJkMXQ==',key_name='tempest-keypair-1184284913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b85a305cdf974d10a935caff8ccec9b4',ramdisk_id='',reservation_id='r-bm8bw4wj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-344410182',owner_user_name='tempest-ServerStableDeviceRescueTest-344410182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:53:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c83afcb788d541d1a3f8c75e5a39c6ce',uuid=07d46763-1b59-4cce-9e10-e94d0efea05d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Converting VIF {"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:1e:21,bridge_name='br-int',has_traffic_filtering=True,id=991f5622-2c12-4ea1-950b-19b55e89c57c,network=Network(557c4953-b996-4cb6-8b45-a1ca6ec545f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991f5622-2c') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG os_vif [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:1e:21,bridge_name='br-int',has_traffic_filtering=True,id=991f5622-2c12-4ea1-950b-19b55e89c57c,network=Network(557c4953-b996-4cb6-8b45-a1ca6ec545f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991f5622-2c') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap991f5622-2c, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap991f5622-2c, col_values=(('external_ids', {'iface-id': '991f5622-2c12-4ea1-950b-19b55e89c57c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:1e:21', 'vm-uuid': '07d46763-1b59-4cce-9e10-e94d0efea05d'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:46 user nova-compute[72815]: INFO os_vif [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:1e:21,bridge_name='br-int',has_traffic_filtering=True,id=991f5622-2c12-4ea1-950b-19b55e89c57c,network=Network(557c4953-b996-4cb6-8b45-a1ca6ec545f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991f5622-2c')
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] No VIF found with MAC fa:16:3e:38:1e:21, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-2eca0b66-b465-4316-941f-b63679287734 req-a44a5e70-48f1-48ca-8ce8-e6bd935adcd3 service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Received event network-vif-plugged-2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2eca0b66-b465-4316-941f-b63679287734 req-a44a5e70-48f1-48ca-8ce8-e6bd935adcd3 service nova] Acquiring lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2eca0b66-b465-4316-941f-b63679287734 req-a44a5e70-48f1-48ca-8ce8-e6bd935adcd3 service nova] Lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2eca0b66-b465-4316-941f-b63679287734 req-a44a5e70-48f1-48ca-8ce8-e6bd935adcd3 service nova] Lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-2eca0b66-b465-4316-941f-b63679287734 req-a44a5e70-48f1-48ca-8ce8-e6bd935adcd3 service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] No waiting events found dispatching network-vif-plugged-2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:53:46 user nova-compute[72815]: WARNING nova.compute.manager [req-2eca0b66-b465-4316-941f-b63679287734 req-a44a5e70-48f1-48ca-8ce8-e6bd935adcd3 service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Received unexpected event network-vif-plugged-2730a429-8948-4303-8bba-ec78e215a242 for instance with vm_state active and task_state None.
Aug 17 19:53:47 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302027.9633555, 1800ab7b-dd88-45fb-9370-1b77b8cbf893 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:53:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] VM Resumed (Lifecycle Event)
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:53:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance spawned successfully.
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:48 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302027.969517, 1800ab7b-dd88-45fb-9370-1b77b8cbf893 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:53:48 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] VM Started (Lifecycle Event)
Aug 17 19:53:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.network.neutron [req-cb58dca9-d835-4479-acb2-0ca87e5c9a59 req-c0aa67c9-2f29-4c81-a5e1-15f051109ad3 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updated VIF entry in instance network info cache for port 991f5622-2c12-4ea1-950b-19b55e89c57c. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.network.neutron [req-cb58dca9-d835-4479-acb2-0ca87e5c9a59 req-c0aa67c9-2f29-4c81-a5e1-15f051109ad3 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updating instance_info_cache with network_info: [{"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cb58dca9-d835-4479-acb2-0ca87e5c9a59 req-c0aa67c9-2f29-4c81-a5e1-15f051109ad3 service nova] Releasing lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:48 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:53:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:48 user nova-compute[72815]: INFO nova.compute.manager [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Took 9.36 seconds to spawn the instance on the hypervisor.
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:48 user nova-compute[72815]: INFO nova.compute.manager [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Took 10.39 seconds to build instance.
Aug 17 19:53:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e1dd6d4-2cc8-4d20-8557-a2ba54c98b40 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.516s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-c178c05f-85bd-4e1c-81da-1f3a49fc9045 req-cf15db53-6689-4ab4-99b6-0c1c9a5636f0 service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Received event network-vif-plugged-2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c178c05f-85bd-4e1c-81da-1f3a49fc9045 req-cf15db53-6689-4ab4-99b6-0c1c9a5636f0 service nova] Acquiring lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c178c05f-85bd-4e1c-81da-1f3a49fc9045 req-cf15db53-6689-4ab4-99b6-0c1c9a5636f0 service nova] Lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c178c05f-85bd-4e1c-81da-1f3a49fc9045 req-cf15db53-6689-4ab4-99b6-0c1c9a5636f0 service nova] Lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-c178c05f-85bd-4e1c-81da-1f3a49fc9045 req-cf15db53-6689-4ab4-99b6-0c1c9a5636f0 service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] No waiting events found dispatching network-vif-plugged-2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:53:48 user nova-compute[72815]: WARNING nova.compute.manager [req-c178c05f-85bd-4e1c-81da-1f3a49fc9045 req-cf15db53-6689-4ab4-99b6-0c1c9a5636f0 service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Received unexpected event network-vif-plugged-2730a429-8948-4303-8bba-ec78e215a242 for instance with vm_state active and task_state None.
Aug 17 19:53:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302032.0205064, 07d46763-1b59-4cce-9e10-e94d0efea05d => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:53:52 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] VM Resumed (Lifecycle Event)
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:53:52 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Instance spawned successfully.
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:53:52 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302032.021013, 07d46763-1b59-4cce-9e10-e94d0efea05d => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:53:52 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] VM Started (Lifecycle Event)
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:53:52 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:53:52 user nova-compute[72815]: INFO nova.compute.manager [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Took 13.97 seconds to spawn the instance on the hypervisor.
Aug 17 19:53:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:53:52 user nova-compute[72815]: INFO nova.compute.manager [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Took 14.86 seconds to build instance.
Aug 17 19:53:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2c13d973-aec5-4c13-9dce-a84b4a203d55 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.987s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-cd3ebd15-3ed6-4361-8031-b9d29c7f1556 req-f597a8af-b17e-426f-a891-829384acabfa service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Received event network-vif-plugged-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:53:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cd3ebd15-3ed6-4361-8031-b9d29c7f1556 req-f597a8af-b17e-426f-a891-829384acabfa service nova] Acquiring lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cd3ebd15-3ed6-4361-8031-b9d29c7f1556 req-f597a8af-b17e-426f-a891-829384acabfa service nova] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cd3ebd15-3ed6-4361-8031-b9d29c7f1556 req-f597a8af-b17e-426f-a891-829384acabfa service nova] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-cd3ebd15-3ed6-4361-8031-b9d29c7f1556 req-f597a8af-b17e-426f-a891-829384acabfa service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] No waiting events found dispatching network-vif-plugged-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:53:54 user nova-compute[72815]: WARNING nova.compute.manager [req-cd3ebd15-3ed6-4361-8031-b9d29c7f1556 req-f597a8af-b17e-426f-a891-829384acabfa service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Received unexpected event network-vif-plugged-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c for instance with vm_state active and task_state None.
Aug 17 19:53:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:53:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-943b4861-8c26-4489-ad8d-64967bee2219 req-ca4dc776-37b2-4eca-8004-0673f521a2a2 service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Received event network-vif-plugged-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:53:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-943b4861-8c26-4489-ad8d-64967bee2219 req-ca4dc776-37b2-4eca-8004-0673f521a2a2 service nova] Acquiring lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-943b4861-8c26-4489-ad8d-64967bee2219 req-ca4dc776-37b2-4eca-8004-0673f521a2a2 service nova] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-943b4861-8c26-4489-ad8d-64967bee2219 req-ca4dc776-37b2-4eca-8004-0673f521a2a2 service nova] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-943b4861-8c26-4489-ad8d-64967bee2219 req-ca4dc776-37b2-4eca-8004-0673f521a2a2 service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] No waiting events found dispatching network-vif-plugged-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:53:56 user nova-compute[72815]: WARNING nova.compute.manager [req-943b4861-8c26-4489-ad8d-64967bee2219 req-ca4dc776-37b2-4eca-8004-0673f521a2a2 service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Received unexpected event network-vif-plugged-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c for instance with vm_state active and task_state None.
Aug 17 19:53:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:57 user nova-compute[72815]: DEBUG nova.compute.manager [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:53:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-1171edee-dbf4-44a0-ae60-0044d2d7e328 req-cc477e0a-0223-4dc3-bd28-3e8d16bd892f service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:53:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1171edee-dbf4-44a0-ae60-0044d2d7e328 req-cc477e0a-0223-4dc3-bd28-3e8d16bd892f service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1171edee-dbf4-44a0-ae60-0044d2d7e328 req-cc477e0a-0223-4dc3-bd28-3e8d16bd892f service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1171edee-dbf4-44a0-ae60-0044d2d7e328 req-cc477e0a-0223-4dc3-bd28-3e8d16bd892f service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-1171edee-dbf4-44a0-ae60-0044d2d7e328 req-cc477e0a-0223-4dc3-bd28-3e8d16bd892f service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:53:57 user nova-compute[72815]: WARNING nova.compute.manager [req-1171edee-dbf4-44a0-ae60-0044d2d7e328 req-cc477e0a-0223-4dc3-bd28-3e8d16bd892f service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state active and task_state None.
Aug 17 19:53:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "969a1301-2014-4b22-8074-a0ac35136249" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "969a1301-2014-4b22-8074-a0ac35136249" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:57 user nova-compute[72815]: DEBUG nova.compute.manager [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:53:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:53:57 user nova-compute[72815]: INFO nova.compute.claims [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Claim successful on node user
Aug 17 19:53:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:58 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:53:58 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:53:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.982s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:58 user nova-compute[72815]: DEBUG nova.compute.manager [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:53:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.821s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:58 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:53:58 user nova-compute[72815]: INFO nova.compute.claims [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Claim successful on node user
Aug 17 19:53:58 user nova-compute[72815]: DEBUG nova.compute.manager [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:53:58 user nova-compute[72815]: DEBUG nova.network.neutron [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:53:58 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 17 19:53:58 user nova-compute[72815]: DEBUG nova.compute.manager [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG nova.policy [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4018e49279c1410abc1630cf519c4817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab7108e8ee94ce5be59f7860980d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:53:59 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Creating image(s)
Aug 17 19:53:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "/opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "/opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "/opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "89c0a6e768dc636c424275cca3f3674e9bcbd38f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "89c0a6e768dc636c424275cca3f3674e9bcbd38f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f.part --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG nova.network.neutron [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:53:59 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:53:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG nova.compute.manager [req-0e3739a3-794f-428a-816d-9e400fbdbc42 req-7f72b44b-fc14-4344-929d-a4650092d156 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0e3739a3-794f-428a-816d-9e400fbdbc42 req-7f72b44b-fc14-4344-929d-a4650092d156 service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0e3739a3-794f-428a-816d-9e400fbdbc42 req-7f72b44b-fc14-4344-929d-a4650092d156 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0e3739a3-794f-428a-816d-9e400fbdbc42 req-7f72b44b-fc14-4344-929d-a4650092d156 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:53:59 user nova-compute[72815]: DEBUG nova.compute.manager [req-0e3739a3-794f-428a-816d-9e400fbdbc42 req-7f72b44b-fc14-4344-929d-a4650092d156 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:53:59 user nova-compute[72815]: WARNING nova.compute.manager [req-0e3739a3-794f-428a-816d-9e400fbdbc42 req-7f72b44b-fc14-4344-929d-a4650092d156 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state active and task_state None.
Aug 17 19:53:59 user nova-compute[72815]: DEBUG nova.policy [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f92e9d1656b4677bc1539c279e60450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f619f5dec7704081974d9a757c392090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:54:00 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Creating image(s)
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "/opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "/opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "/opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f.part --force-share --output=json" returned: 0 in 0.430s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG nova.virt.images [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] c98c415f-ad19-49d8-8259-02102cc59bbd was qcow2, converting to raw {{(pid=72815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f.part /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f.converted {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG nova.network.neutron [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Successfully created port: 8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f.part /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f.converted" returned: 0 in 0.320s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f.converted --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.317s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f.converted --force-share --output=json" returned: 0 in 0.255s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "89c0a6e768dc636c424275cca3f3674e9bcbd38f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.612s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.298s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk 1073741824" returned: 0 in 0.073s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.391s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f --force-share --output=json" returned: 0 in 0.321s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "89c0a6e768dc636c424275cca3f3674e9bcbd38f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "89c0a6e768dc636c424275cca3f3674e9bcbd38f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.226s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.network.neutron [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Successfully created port: 71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f --force-share --output=json" returned: 0 in 0.248s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f,backing_fmt=raw /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f,backing_fmt=raw /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk 1073741824" returned: 0 in 0.060s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "89c0a6e768dc636c424275cca3f3674e9bcbd38f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Cannot resize image /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.objects.instance [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lazy-loading 'migration_context' on Instance uuid 969a1301-2014-4b22-8074-a0ac35136249 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Ensure instance console log exists: /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Acquiring lock "e4a8f42b-da98-4652-be1f-393b790a87f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Cannot resize image /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.objects.instance [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lazy-loading 'migration_context' on Instance uuid d00ba879-4c0f-4682-be36-8d61f44af9cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Ensure instance console log exists: /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:54:01 user nova-compute[72815]: INFO nova.compute.claims [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Claim successful on node user
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Successfully updated port: 71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "refresh_cache-969a1301-2014-4b22-8074-a0ac35136249" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquired lock "refresh_cache-969a1301-2014-4b22-8074-a0ac35136249" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.678s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-7f610088-dbc8-45b1-b921-a0bd2825ca6c req-d57e5877-f90d-40a6-a63d-82fe7d3603f0 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Received event network-changed-71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-7f610088-dbc8-45b1-b921-a0bd2825ca6c req-d57e5877-f90d-40a6-a63d-82fe7d3603f0 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Refreshing instance network info cache due to event network-changed-71991ae2-1663-4a4f-a0c6-ab4a271580c0. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7f610088-dbc8-45b1-b921-a0bd2825ca6c req-d57e5877-f90d-40a6-a63d-82fe7d3603f0 service nova] Acquiring lock "refresh_cache-969a1301-2014-4b22-8074-a0ac35136249" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:54:02 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Successfully updated port: 8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:54:02 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Creating image(s)
Aug 17 19:54:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "/opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "/opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "refresh_cache-d00ba879-4c0f-4682-be36-8d61f44af9cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquired lock "refresh_cache-d00ba879-4c0f-4682-be36-8d61f44af9cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.policy [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0d1c860d9814e588e14ba4ceefdac0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a41f966cc44316a220e0379417d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-a199d1c4-5fdf-41d6-a9c4-a237d364dd6b req-866ea4a4-c7e5-47d9-955c-0b4c4ddee1bf service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Received event network-changed-8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-a199d1c4-5fdf-41d6-a9c4-a237d364dd6b req-866ea4a4-c7e5-47d9-955c-0b4c4ddee1bf service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Refreshing instance network info cache due to event network-changed-8fe39d89-b180-4d36-aa58-5956cc68e1b9. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:54:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a199d1c4-5fdf-41d6-a9c4-a237d364dd6b req-866ea4a4-c7e5-47d9-955c-0b4c4ddee1bf service nova] Acquiring lock "refresh_cache-d00ba879-4c0f-4682-be36-8d61f44af9cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-72aee079-6b88-460a-b172-6e40086f2221 req-7a2d1d02-e900-40b9-a76b-ca553d72fa36 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Received event network-vif-plugged-d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-72aee079-6b88-460a-b172-6e40086f2221 req-7a2d1d02-e900-40b9-a76b-ca553d72fa36 service nova] Acquiring lock "ab784398-43df-4214-bdd3-22c652ac710f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-72aee079-6b88-460a-b172-6e40086f2221 req-7a2d1d02-e900-40b9-a76b-ca553d72fa36 service nova] Lock "ab784398-43df-4214-bdd3-22c652ac710f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-72aee079-6b88-460a-b172-6e40086f2221 req-7a2d1d02-e900-40b9-a76b-ca553d72fa36 service nova] Lock "ab784398-43df-4214-bdd3-22c652ac710f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-72aee079-6b88-460a-b172-6e40086f2221 req-7a2d1d02-e900-40b9-a76b-ca553d72fa36 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] No waiting events found dispatching network-vif-plugged-d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:03 user nova-compute[72815]: WARNING nova.compute.manager [req-72aee079-6b88-460a-b172-6e40086f2221 req-7a2d1d02-e900-40b9-a76b-ca553d72fa36 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Received unexpected event network-vif-plugged-d049d487-388c-408b-ada5-ae68e86585c3 for instance with vm_state active and task_state None.
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.274s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Updating instance_info_cache with network_info: [{"id": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "address": "fa:16:3e:e1:b7:04", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71991ae2-16", "ovs_interfaceid": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Releasing lock "refresh_cache-969a1301-2014-4b22-8074-a0ac35136249" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.compute.manager [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Instance network_info: |[{"id": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "address": "fa:16:3e:e1:b7:04", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71991ae2-16", "ovs_interfaceid": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7f610088-dbc8-45b1-b921-a0bd2825ca6c req-d57e5877-f90d-40a6-a63d-82fe7d3603f0 service nova] Acquired lock "refresh_cache-969a1301-2014-4b22-8074-a0ac35136249" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.network.neutron [req-7f610088-dbc8-45b1-b921-a0bd2825ca6c req-d57e5877-f90d-40a6-a63d-82fe7d3603f0 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Refreshing network info cache for port 71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Start _get_guest_xml network_info=[{"id": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "address": "fa:16:3e:e1:b7:04", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71991ae2-16", "ovs_interfaceid": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.250s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk 1073741824" returned: 0 in 0.066s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:03 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:54:03 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1178808682',display_name='tempest-VolumesAdminNegativeTest-server-1178808682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1178808682',id=7,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPMQCVfuUWmUlftiTIms4TWB5EFRLzDImOgY7ed4m4FFkwrp+11w0GzZ+hT5llRfeDVKIKvS9LTPCcTBkyfcHyNgHe/HpVqAJCmvaW67RMfdrrMjpN0Iqi5XijoTuLBLg==',key_name='tempest-keypair-141777476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f619f5dec7704081974d9a757c392090',ramdisk_id='',reservation_id='r-1leqk0cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-380028141',owner_user_name='tempest-VolumesAdminNegativeTest-380028141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:54:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f92e9d1656b4677bc1539c279e60450',uuid=969a1301-2014-4b22-8074-a0ac35136249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "address": "fa:16:3e:e1:b7:04", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71991ae2-16", "ovs_interfaceid": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Converting VIF {"id": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "address": "fa:16:3e:e1:b7:04", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71991ae2-16", "ovs_interfaceid": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b7:04,bridge_name='br-int',has_traffic_filtering=True,id=71991ae2-1663-4a4f-a0c6-ab4a271580c0,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71991ae2-16') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.objects.instance [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lazy-loading 'pci_devices' on Instance uuid 969a1301-2014-4b22-8074-a0ac35136249 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:54:03 user nova-compute[72815]:   <uuid>969a1301-2014-4b22-8074-a0ac35136249</uuid>
Aug 17 19:54:03 user nova-compute[72815]:   <name>instance-00000007</name>
Aug 17 19:54:03 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:54:03 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:54:03 user nova-compute[72815]:   <metadata>
Aug 17 19:54:03 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:54:03 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:54:03 user nova-compute[72815]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1178808682</nova:name>
Aug 17 19:54:03 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:54:03</nova:creationTime>
Aug 17 19:54:03 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:54:03 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:54:03 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:54:03 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:54:03 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:54:03 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:54:03 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:54:03 user nova-compute[72815]:       <nova:owner>
Aug 17 19:54:03 user nova-compute[72815]:         <nova:user uuid="5f92e9d1656b4677bc1539c279e60450">tempest-VolumesAdminNegativeTest-380028141-project-member</nova:user>
Aug 17 19:54:03 user nova-compute[72815]:         <nova:project uuid="f619f5dec7704081974d9a757c392090">tempest-VolumesAdminNegativeTest-380028141</nova:project>
Aug 17 19:54:03 user nova-compute[72815]:       </nova:owner>
Aug 17 19:54:03 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:54:03 user nova-compute[72815]:       <nova:ports>
Aug 17 19:54:03 user nova-compute[72815]:         <nova:port uuid="71991ae2-1663-4a4f-a0c6-ab4a271580c0">
Aug 17 19:54:03 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 19:54:03 user nova-compute[72815]:         </nova:port>
Aug 17 19:54:03 user nova-compute[72815]:       </nova:ports>
Aug 17 19:54:03 user nova-compute[72815]:     </nova:instance>
Aug 17 19:54:03 user nova-compute[72815]:   </metadata>
Aug 17 19:54:03 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:54:03 user nova-compute[72815]:     <system>
Aug 17 19:54:03 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:54:03 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:54:03 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:54:03 user nova-compute[72815]:       <entry name="serial">969a1301-2014-4b22-8074-a0ac35136249</entry>
Aug 17 19:54:03 user nova-compute[72815]:       <entry name="uuid">969a1301-2014-4b22-8074-a0ac35136249</entry>
Aug 17 19:54:03 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:54:03 user nova-compute[72815]:     </system>
Aug 17 19:54:03 user nova-compute[72815]:   </sysinfo>
Aug 17 19:54:03 user nova-compute[72815]:   <os>
Aug 17 19:54:03 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:54:03 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:54:03 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:54:03 user nova-compute[72815]:   </os>
Aug 17 19:54:03 user nova-compute[72815]:   <features>
Aug 17 19:54:03 user nova-compute[72815]:     <acpi/>
Aug 17 19:54:03 user nova-compute[72815]:     <apic/>
Aug 17 19:54:03 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:54:03 user nova-compute[72815]:   </features>
Aug 17 19:54:03 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:54:03 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:54:03 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:54:03 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:54:03 user nova-compute[72815]:   </clock>
Aug 17 19:54:03 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:54:03 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:54:03 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:54:03 user nova-compute[72815]:   </cpu>
Aug 17 19:54:03 user nova-compute[72815]:   <devices>
Aug 17 19:54:03 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:54:03 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:54:03 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk"/>
Aug 17 19:54:03 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:54:03 user nova-compute[72815]:     </disk>
Aug 17 19:54:03 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:54:03 user nova-compute[72815]:       <mac address="fa:16:3e:e1:b7:04"/>
Aug 17 19:54:03 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:54:03 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:54:03 user nova-compute[72815]:       <target dev="tap71991ae2-16"/>
Aug 17 19:54:03 user nova-compute[72815]:     </interface>
Aug 17 19:54:03 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:54:03 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/console.log" append="off"/>
Aug 17 19:54:03 user nova-compute[72815]:     </serial>
Aug 17 19:54:03 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:54:03 user nova-compute[72815]:     <video>
Aug 17 19:54:03 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:54:03 user nova-compute[72815]:     </video>
Aug 17 19:54:03 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:54:03 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:54:03 user nova-compute[72815]:     </rng>
Aug 17 19:54:03 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:54:03 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:54:03 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:54:03 user nova-compute[72815]:     </memballoon>
Aug 17 19:54:03 user nova-compute[72815]:   </devices>
Aug 17 19:54:03 user nova-compute[72815]: </domain>
Aug 17 19:54:03 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1178808682',display_name='tempest-VolumesAdminNegativeTest-server-1178808682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1178808682',id=7,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPMQCVfuUWmUlftiTIms4TWB5EFRLzDImOgY7ed4m4FFkwrp+11w0GzZ+hT5llRfeDVKIKvS9LTPCcTBkyfcHyNgHe/HpVqAJCmvaW67RMfdrrMjpN0Iqi5XijoTuLBLg==',key_name='tempest-keypair-141777476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f619f5dec7704081974d9a757c392090',ramdisk_id='',reservation_id='r-1leqk0cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-380028141',owner_user_name='tempest-VolumesAdminNegativeTest-380028141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:54:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f92e9d1656b4677bc1539c279e60450',uuid=969a1301-2014-4b22-8074-a0ac35136249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "address": "fa:16:3e:e1:b7:04", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71991ae2-16", "ovs_interfaceid": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Converting VIF {"id": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "address": "fa:16:3e:e1:b7:04", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71991ae2-16", "ovs_interfaceid": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b7:04,bridge_name='br-int',has_traffic_filtering=True,id=71991ae2-1663-4a4f-a0c6-ab4a271580c0,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71991ae2-16') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG os_vif [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b7:04,bridge_name='br-int',has_traffic_filtering=True,id=71991ae2-1663-4a4f-a0c6-ab4a271580c0,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71991ae2-16') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71991ae2-16, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71991ae2-16, col_values=(('external_ids', {'iface-id': '71991ae2-1663-4a4f-a0c6-ab4a271580c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:b7:04', 'vm-uuid': '969a1301-2014-4b22-8074-a0ac35136249'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:03 user nova-compute[72815]: INFO os_vif [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b7:04,bridge_name='br-int',has_traffic_filtering=True,id=71991ae2-1663-4a4f-a0c6-ab4a271580c0,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71991ae2-16')
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.264s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] No VIF found with MAC fa:16:3e:e1:b7:04, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Cannot resize image /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lazy-loading 'migration_context' on Instance uuid e4a8f42b-da98-4652-be1f-393b790a87f1 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Ensure instance console log exists: /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.network.neutron [req-7f610088-dbc8-45b1-b921-a0bd2825ca6c req-d57e5877-f90d-40a6-a63d-82fe7d3603f0 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Updated VIF entry in instance network info cache for port 71991ae2-1663-4a4f-a0c6-ab4a271580c0. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:54:03 user nova-compute[72815]: DEBUG nova.network.neutron [req-7f610088-dbc8-45b1-b921-a0bd2825ca6c req-d57e5877-f90d-40a6-a63d-82fe7d3603f0 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Updating instance_info_cache with network_info: [{"id": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "address": "fa:16:3e:e1:b7:04", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71991ae2-16", "ovs_interfaceid": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7f610088-dbc8-45b1-b921-a0bd2825ca6c req-d57e5877-f90d-40a6-a63d-82fe7d3603f0 service nova] Releasing lock "refresh_cache-969a1301-2014-4b22-8074-a0ac35136249" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.network.neutron [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Updating instance_info_cache with network_info: [{"id": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "address": "fa:16:3e:c1:d6:5f", "network": {"id": "cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1059060149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cab7108e8ee94ce5be59f7860980d489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe39d89-b1", "ovs_interfaceid": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Releasing lock "refresh_cache-d00ba879-4c0f-4682-be36-8d61f44af9cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Instance network_info: |[{"id": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "address": "fa:16:3e:c1:d6:5f", "network": {"id": "cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1059060149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cab7108e8ee94ce5be59f7860980d489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe39d89-b1", "ovs_interfaceid": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a199d1c4-5fdf-41d6-a9c4-a237d364dd6b req-866ea4a4-c7e5-47d9-955c-0b4c4ddee1bf service nova] Acquired lock "refresh_cache-d00ba879-4c0f-4682-be36-8d61f44af9cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.network.neutron [req-a199d1c4-5fdf-41d6-a9c4-a237d364dd6b req-866ea4a4-c7e5-47d9-955c-0b4c4ddee1bf service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Refreshing network info cache for port 8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Start _get_guest_xml network_info=[{"id": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "address": "fa:16:3e:c1:d6:5f", "network": {"id": "cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1059060149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cab7108e8ee94ce5be59f7860980d489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe39d89-b1", "ovs_interfaceid": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:53:47Z,direct_url=<?>,disk_format='qcow2',id=c98c415f-ad19-49d8-8259-02102cc59bbd,min_disk=0,min_ram=0,name='',owner='97bc3a62657947b0851d2e9c4287f622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:53:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': 'c98c415f-ad19-49d8-8259-02102cc59bbd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:54:04 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:54:04 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:53:47Z,direct_url=<?>,disk_format='qcow2',id=c98c415f-ad19-49d8-8259-02102cc59bbd,min_disk=0,min_ram=0,name='',owner='97bc3a62657947b0851d2e9c4287f622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:53:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-75433482',display_name='tempest-AttachSCSIVolumeTestJSON-server-75433482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-75433482',id=6,image_ref='c98c415f-ad19-49d8-8259-02102cc59bbd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUSj3xmeHrpLu4AWVL10sVmg3+CLvfChvkRscrZ/9Lm72146qtY7SXiXc7/Y0Bc8C2Cc9skB3T0uPNGbwEMNdH+tgdNCC5zYiR8Tfy4MnFgkqkUPYt1aIdwwf/AMiamfA==',key_name='tempest-keypair-201462846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cab7108e8ee94ce5be59f7860980d489',ramdisk_id='',reservation_id='r-vahtl3bb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c98c415f-ad19-49d8-8259-02102cc59bbd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1819262802',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1819262802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4018e49279c1410abc1630cf519c4817',uuid=d00ba879-4c0f-4682-be36-8d61f44af9cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "address": "fa:16:3e:c1:d6:5f", "network": {"id": "cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1059060149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cab7108e8ee94ce5be59f7860980d489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe39d89-b1", "ovs_interfaceid": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Converting VIF {"id": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "address": "fa:16:3e:c1:d6:5f", "network": {"id": "cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1059060149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cab7108e8ee94ce5be59f7860980d489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe39d89-b1", "ovs_interfaceid": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d6:5f,bridge_name='br-int',has_traffic_filtering=True,id=8fe39d89-b180-4d36-aa58-5956cc68e1b9,network=Network(cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe39d89-b1') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.objects.instance [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lazy-loading 'pci_devices' on Instance uuid d00ba879-4c0f-4682-be36-8d61f44af9cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:54:04 user nova-compute[72815]:   <uuid>d00ba879-4c0f-4682-be36-8d61f44af9cf</uuid>
Aug 17 19:54:04 user nova-compute[72815]:   <name>instance-00000006</name>
Aug 17 19:54:04 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:54:04 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:54:04 user nova-compute[72815]:   <metadata>
Aug 17 19:54:04 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:54:04 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:54:04 user nova-compute[72815]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-75433482</nova:name>
Aug 17 19:54:04 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:54:04</nova:creationTime>
Aug 17 19:54:04 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:54:04 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:54:04 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:54:04 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:54:04 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:54:04 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:54:04 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:54:04 user nova-compute[72815]:       <nova:owner>
Aug 17 19:54:04 user nova-compute[72815]:         <nova:user uuid="4018e49279c1410abc1630cf519c4817">tempest-AttachSCSIVolumeTestJSON-1819262802-project-member</nova:user>
Aug 17 19:54:04 user nova-compute[72815]:         <nova:project uuid="cab7108e8ee94ce5be59f7860980d489">tempest-AttachSCSIVolumeTestJSON-1819262802</nova:project>
Aug 17 19:54:04 user nova-compute[72815]:       </nova:owner>
Aug 17 19:54:04 user nova-compute[72815]:       <nova:root type="image" uuid="c98c415f-ad19-49d8-8259-02102cc59bbd"/>
Aug 17 19:54:04 user nova-compute[72815]:       <nova:ports>
Aug 17 19:54:04 user nova-compute[72815]:         <nova:port uuid="8fe39d89-b180-4d36-aa58-5956cc68e1b9">
Aug 17 19:54:04 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 19:54:04 user nova-compute[72815]:         </nova:port>
Aug 17 19:54:04 user nova-compute[72815]:       </nova:ports>
Aug 17 19:54:04 user nova-compute[72815]:     </nova:instance>
Aug 17 19:54:04 user nova-compute[72815]:   </metadata>
Aug 17 19:54:04 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:54:04 user nova-compute[72815]:     <system>
Aug 17 19:54:04 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:54:04 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:54:04 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:54:04 user nova-compute[72815]:       <entry name="serial">d00ba879-4c0f-4682-be36-8d61f44af9cf</entry>
Aug 17 19:54:04 user nova-compute[72815]:       <entry name="uuid">d00ba879-4c0f-4682-be36-8d61f44af9cf</entry>
Aug 17 19:54:04 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:54:04 user nova-compute[72815]:     </system>
Aug 17 19:54:04 user nova-compute[72815]:   </sysinfo>
Aug 17 19:54:04 user nova-compute[72815]:   <os>
Aug 17 19:54:04 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:54:04 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:54:04 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:54:04 user nova-compute[72815]:   </os>
Aug 17 19:54:04 user nova-compute[72815]:   <features>
Aug 17 19:54:04 user nova-compute[72815]:     <acpi/>
Aug 17 19:54:04 user nova-compute[72815]:     <apic/>
Aug 17 19:54:04 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:54:04 user nova-compute[72815]:   </features>
Aug 17 19:54:04 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:54:04 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:54:04 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:54:04 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:54:04 user nova-compute[72815]:   </clock>
Aug 17 19:54:04 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:54:04 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:54:04 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:54:04 user nova-compute[72815]:   </cpu>
Aug 17 19:54:04 user nova-compute[72815]:   <devices>
Aug 17 19:54:04 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:54:04 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:54:04 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk"/>
Aug 17 19:54:04 user nova-compute[72815]:       <target dev="sda" bus="scsi"/>
Aug 17 19:54:04 user nova-compute[72815]:       <address type="drive" controller="0" unit="0"/>
Aug 17 19:54:04 user nova-compute[72815]:     </disk>
Aug 17 19:54:04 user nova-compute[72815]:     <disk type="file" device="cdrom">
Aug 17 19:54:04 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 19:54:04 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk.config"/>
Aug 17 19:54:04 user nova-compute[72815]:       <target dev="sdb" bus="scsi"/>
Aug 17 19:54:04 user nova-compute[72815]:       <address type="drive" controller="0" unit="1"/>
Aug 17 19:54:04 user nova-compute[72815]:     </disk>
Aug 17 19:54:04 user nova-compute[72815]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 17 19:54:04 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:54:04 user nova-compute[72815]:       <mac address="fa:16:3e:c1:d6:5f"/>
Aug 17 19:54:04 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:54:04 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:54:04 user nova-compute[72815]:       <target dev="tap8fe39d89-b1"/>
Aug 17 19:54:04 user nova-compute[72815]:     </interface>
Aug 17 19:54:04 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:54:04 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/console.log" append="off"/>
Aug 17 19:54:04 user nova-compute[72815]:     </serial>
Aug 17 19:54:04 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:54:04 user nova-compute[72815]:     <video>
Aug 17 19:54:04 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:54:04 user nova-compute[72815]:     </video>
Aug 17 19:54:04 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:54:04 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:54:04 user nova-compute[72815]:     </rng>
Aug 17 19:54:04 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:54:04 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:54:04 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:54:04 user nova-compute[72815]:     </memballoon>
Aug 17 19:54:04 user nova-compute[72815]:   </devices>
Aug 17 19:54:04 user nova-compute[72815]: </domain>
Aug 17 19:54:04 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-75433482',display_name='tempest-AttachSCSIVolumeTestJSON-server-75433482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-75433482',id=6,image_ref='c98c415f-ad19-49d8-8259-02102cc59bbd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUSj3xmeHrpLu4AWVL10sVmg3+CLvfChvkRscrZ/9Lm72146qtY7SXiXc7/Y0Bc8C2Cc9skB3T0uPNGbwEMNdH+tgdNCC5zYiR8Tfy4MnFgkqkUPYt1aIdwwf/AMiamfA==',key_name='tempest-keypair-201462846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cab7108e8ee94ce5be59f7860980d489',ramdisk_id='',reservation_id='r-vahtl3bb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c98c415f-ad19-49d8-8259-02102cc59bbd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1819262802',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1819262802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4018e49279c1410abc1630cf519c4817',uuid=d00ba879-4c0f-4682-be36-8d61f44af9cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "address": "fa:16:3e:c1:d6:5f", "network": {"id": "cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1059060149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cab7108e8ee94ce5be59f7860980d489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe39d89-b1", "ovs_interfaceid": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Converting VIF {"id": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "address": "fa:16:3e:c1:d6:5f", "network": {"id": "cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1059060149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cab7108e8ee94ce5be59f7860980d489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe39d89-b1", "ovs_interfaceid": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d6:5f,bridge_name='br-int',has_traffic_filtering=True,id=8fe39d89-b180-4d36-aa58-5956cc68e1b9,network=Network(cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe39d89-b1') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG os_vif [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d6:5f,bridge_name='br-int',has_traffic_filtering=True,id=8fe39d89-b180-4d36-aa58-5956cc68e1b9,network=Network(cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe39d89-b1') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fe39d89-b1, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fe39d89-b1, col_values=(('external_ids', {'iface-id': '8fe39d89-b180-4d36-aa58-5956cc68e1b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:d6:5f', 'vm-uuid': 'd00ba879-4c0f-4682-be36-8d61f44af9cf'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:04 user nova-compute[72815]: INFO os_vif [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d6:5f,bridge_name='br-int',has_traffic_filtering=True,id=8fe39d89-b180-4d36-aa58-5956cc68e1b9,network=Network(cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe39d89-b1')
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] No BDM found with device name sda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:54:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] No VIF found with MAC fa:16:3e:c1:d6:5f, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:54:04 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Using config drive
Aug 17 19:54:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Creating config drive at /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk.config
Aug 17 19:54:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpswce75d5 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-4dbf5314-6d9e-42df-a22a-5d5272a7d021 req-6918163b-77ef-4535-843b-ced02bbaf14d service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Received event network-vif-plugged-d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4dbf5314-6d9e-42df-a22a-5d5272a7d021 req-6918163b-77ef-4535-843b-ced02bbaf14d service nova] Acquiring lock "ab784398-43df-4214-bdd3-22c652ac710f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4dbf5314-6d9e-42df-a22a-5d5272a7d021 req-6918163b-77ef-4535-843b-ced02bbaf14d service nova] Lock "ab784398-43df-4214-bdd3-22c652ac710f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4dbf5314-6d9e-42df-a22a-5d5272a7d021 req-6918163b-77ef-4535-843b-ced02bbaf14d service nova] Lock "ab784398-43df-4214-bdd3-22c652ac710f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-4dbf5314-6d9e-42df-a22a-5d5272a7d021 req-6918163b-77ef-4535-843b-ced02bbaf14d service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] No waiting events found dispatching network-vif-plugged-d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:05 user nova-compute[72815]: WARNING nova.compute.manager [req-4dbf5314-6d9e-42df-a22a-5d5272a7d021 req-6918163b-77ef-4535-843b-ced02bbaf14d service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Received unexpected event network-vif-plugged-d049d487-388c-408b-ada5-ae68e86585c3 for instance with vm_state active and task_state None.
Aug 17 19:54:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpswce75d5" returned: 0 in 0.073s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Successfully created port: 9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG nova.network.neutron [req-a199d1c4-5fdf-41d6-a9c4-a237d364dd6b req-866ea4a4-c7e5-47d9-955c-0b4c4ddee1bf service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Updated VIF entry in instance network info cache for port 8fe39d89-b180-4d36-aa58-5956cc68e1b9. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG nova.network.neutron [req-a199d1c4-5fdf-41d6-a9c4-a237d364dd6b req-866ea4a4-c7e5-47d9-955c-0b4c4ddee1bf service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Updating instance_info_cache with network_info: [{"id": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "address": "fa:16:3e:c1:d6:5f", "network": {"id": "cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1059060149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cab7108e8ee94ce5be59f7860980d489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe39d89-b1", "ovs_interfaceid": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a199d1c4-5fdf-41d6-a9c4-a237d364dd6b req-866ea4a4-c7e5-47d9-955c-0b4c4ddee1bf service nova] Releasing lock "refresh_cache-d00ba879-4c0f-4682-be36-8d61f44af9cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:54:06 user nova-compute[72815]: INFO nova.compute.claims [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Claim successful on node user
Aug 17 19:54:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-fe48e25c-981b-45bc-ab77-49f2715a2cbf req-90965915-7bed-4532-b867-42f840939d4c service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fe48e25c-981b-45bc-ab77-49f2715a2cbf req-90965915-7bed-4532-b867-42f840939d4c service nova] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fe48e25c-981b-45bc-ab77-49f2715a2cbf req-90965915-7bed-4532-b867-42f840939d4c service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fe48e25c-981b-45bc-ab77-49f2715a2cbf req-90965915-7bed-4532-b867-42f840939d4c service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-fe48e25c-981b-45bc-ab77-49f2715a2cbf req-90965915-7bed-4532-b867-42f840939d4c service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] No waiting events found dispatching network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:06 user nova-compute[72815]: WARNING nova.compute.manager [req-fe48e25c-981b-45bc-ab77-49f2715a2cbf req-90965915-7bed-4532-b867-42f840939d4c service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received unexpected event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e for instance with vm_state active and task_state None.
Aug 17 19:54:06 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:54:06 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:54:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:54:06 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Creating image(s)
Aug 17 19:54:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG nova.policy [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a78dad1c02084db9b032efb86f7a503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba66c6a1bf494f867c7eec572d4880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.227s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Successfully updated port: 9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Acquiring lock "refresh_cache-e4a8f42b-da98-4652-be1f-393b790a87f1" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Acquired lock "refresh_cache-e4a8f42b-da98-4652-be1f-393b790a87f1" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-0e813f8d-2d0d-4950-bf37-bb1f2dae7662 req-8b1bdb76-15b4-4b67-8906-5b809faff802 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Received event network-changed-9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-0e813f8d-2d0d-4950-bf37-bb1f2dae7662 req-8b1bdb76-15b4-4b67-8906-5b809faff802 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Refreshing instance network info cache due to event network-changed-9c5a165c-656c-45af-833a-b69c3b2f73e0. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0e813f8d-2d0d-4950-bf37-bb1f2dae7662 req-8b1bdb76-15b4-4b67-8906-5b809faff802 service nova] Acquiring lock "refresh_cache-e4a8f42b-da98-4652-be1f-393b790a87f1" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.287s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk 1073741824" returned: 0 in 0.063s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.241s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:54:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json" returned: 0 in 0.354s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Cannot resize image /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lazy-loading 'migration_context' on Instance uuid 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Ensure instance console log exists: /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Updating instance_info_cache with network_info: [{"id": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "address": "fa:16:3e:60:5d:1b", "network": {"id": "5f00031c-acd2-4226-84e3-c79acbb25528", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1468450531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a41f966cc44316a220e0379417d9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5a165c-65", "ovs_interfaceid": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Releasing lock "refresh_cache-e4a8f42b-da98-4652-be1f-393b790a87f1" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Instance network_info: |[{"id": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "address": "fa:16:3e:60:5d:1b", "network": {"id": "5f00031c-acd2-4226-84e3-c79acbb25528", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1468450531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a41f966cc44316a220e0379417d9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5a165c-65", "ovs_interfaceid": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0e813f8d-2d0d-4950-bf37-bb1f2dae7662 req-8b1bdb76-15b4-4b67-8906-5b809faff802 service nova] Acquired lock "refresh_cache-e4a8f42b-da98-4652-be1f-393b790a87f1" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-0e813f8d-2d0d-4950-bf37-bb1f2dae7662 req-8b1bdb76-15b4-4b67-8906-5b809faff802 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Refreshing network info cache for port 9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Start _get_guest_xml network_info=[{"id": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "address": "fa:16:3e:60:5d:1b", "network": {"id": "5f00031c-acd2-4226-84e3-c79acbb25528", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1468450531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a41f966cc44316a220e0379417d9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5a165c-65", "ovs_interfaceid": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:54:08 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:54:08 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1084348631',display_name='tempest-VolumesAssistedSnapshotsTest-server-1084348631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1084348631',id=8,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuEl0yIhyErrry1myadcIGOc9RewPSuBMmBtcFxbi8SkDclXHXRd1xicjabWMA/rnBcd9qxNEqDAxo/IOBNm7pBhyd3CxMnu3Gu2B+HiuhxL21fnvKPGbinVzqKigs4MQ==',key_name='tempest-keypair-1212091376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61a41f966cc44316a220e0379417d9f8',ramdisk_id='',reservation_id='r-pcfgj9w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-193187624',owner_user_name='tempest-VolumesAssistedSnapshotsTest-193187624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0d1c860d9814e588e14ba4ceefdac0a',uuid=e4a8f42b-da98-4652-be1f-393b790a87f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "address": "fa:16:3e:60:5d:1b", "network": {"id": "5f00031c-acd2-4226-84e3-c79acbb25528", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1468450531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a41f966cc44316a220e0379417d9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5a165c-65", "ovs_interfaceid": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Converting VIF {"id": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "address": "fa:16:3e:60:5d:1b", "network": {"id": "5f00031c-acd2-4226-84e3-c79acbb25528", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1468450531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a41f966cc44316a220e0379417d9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5a165c-65", "ovs_interfaceid": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:5d:1b,bridge_name='br-int',has_traffic_filtering=True,id=9c5a165c-656c-45af-833a-b69c3b2f73e0,network=Network(5f00031c-acd2-4226-84e3-c79acbb25528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5a165c-65') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lazy-loading 'pci_devices' on Instance uuid e4a8f42b-da98-4652-be1f-393b790a87f1 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:54:08 user nova-compute[72815]:   <uuid>e4a8f42b-da98-4652-be1f-393b790a87f1</uuid>
Aug 17 19:54:08 user nova-compute[72815]:   <name>instance-00000008</name>
Aug 17 19:54:08 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:54:08 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:54:08 user nova-compute[72815]:   <metadata>
Aug 17 19:54:08 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:54:08 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:54:08 user nova-compute[72815]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1084348631</nova:name>
Aug 17 19:54:08 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:54:08</nova:creationTime>
Aug 17 19:54:08 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:54:08 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:54:08 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:54:08 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:54:08 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:54:08 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:54:08 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:54:08 user nova-compute[72815]:       <nova:owner>
Aug 17 19:54:08 user nova-compute[72815]:         <nova:user uuid="e0d1c860d9814e588e14ba4ceefdac0a">tempest-VolumesAssistedSnapshotsTest-193187624-project-member</nova:user>
Aug 17 19:54:08 user nova-compute[72815]:         <nova:project uuid="61a41f966cc44316a220e0379417d9f8">tempest-VolumesAssistedSnapshotsTest-193187624</nova:project>
Aug 17 19:54:08 user nova-compute[72815]:       </nova:owner>
Aug 17 19:54:08 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:54:08 user nova-compute[72815]:       <nova:ports>
Aug 17 19:54:08 user nova-compute[72815]:         <nova:port uuid="9c5a165c-656c-45af-833a-b69c3b2f73e0">
Aug 17 19:54:08 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 19:54:08 user nova-compute[72815]:         </nova:port>
Aug 17 19:54:08 user nova-compute[72815]:       </nova:ports>
Aug 17 19:54:08 user nova-compute[72815]:     </nova:instance>
Aug 17 19:54:08 user nova-compute[72815]:   </metadata>
Aug 17 19:54:08 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:54:08 user nova-compute[72815]:     <system>
Aug 17 19:54:08 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:54:08 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:54:08 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:54:08 user nova-compute[72815]:       <entry name="serial">e4a8f42b-da98-4652-be1f-393b790a87f1</entry>
Aug 17 19:54:08 user nova-compute[72815]:       <entry name="uuid">e4a8f42b-da98-4652-be1f-393b790a87f1</entry>
Aug 17 19:54:08 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:54:08 user nova-compute[72815]:     </system>
Aug 17 19:54:08 user nova-compute[72815]:   </sysinfo>
Aug 17 19:54:08 user nova-compute[72815]:   <os>
Aug 17 19:54:08 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:54:08 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:54:08 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:54:08 user nova-compute[72815]:   </os>
Aug 17 19:54:08 user nova-compute[72815]:   <features>
Aug 17 19:54:08 user nova-compute[72815]:     <acpi/>
Aug 17 19:54:08 user nova-compute[72815]:     <apic/>
Aug 17 19:54:08 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:54:08 user nova-compute[72815]:   </features>
Aug 17 19:54:08 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:54:08 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:54:08 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:54:08 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:54:08 user nova-compute[72815]:   </clock>
Aug 17 19:54:08 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:54:08 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:54:08 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:54:08 user nova-compute[72815]:   </cpu>
Aug 17 19:54:08 user nova-compute[72815]:   <devices>
Aug 17 19:54:08 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:54:08 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:54:08 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk"/>
Aug 17 19:54:08 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:54:08 user nova-compute[72815]:     </disk>
Aug 17 19:54:08 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:54:08 user nova-compute[72815]:       <mac address="fa:16:3e:60:5d:1b"/>
Aug 17 19:54:08 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:54:08 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:54:08 user nova-compute[72815]:       <target dev="tap9c5a165c-65"/>
Aug 17 19:54:08 user nova-compute[72815]:     </interface>
Aug 17 19:54:08 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:54:08 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/console.log" append="off"/>
Aug 17 19:54:08 user nova-compute[72815]:     </serial>
Aug 17 19:54:08 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:54:08 user nova-compute[72815]:     <video>
Aug 17 19:54:08 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:54:08 user nova-compute[72815]:     </video>
Aug 17 19:54:08 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:54:08 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:54:08 user nova-compute[72815]:     </rng>
Aug 17 19:54:08 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:54:08 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:54:08 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:54:08 user nova-compute[72815]:     </memballoon>
Aug 17 19:54:08 user nova-compute[72815]:   </devices>
Aug 17 19:54:08 user nova-compute[72815]: </domain>
Aug 17 19:54:08 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1084348631',display_name='tempest-VolumesAssistedSnapshotsTest-server-1084348631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1084348631',id=8,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuEl0yIhyErrry1myadcIGOc9RewPSuBMmBtcFxbi8SkDclXHXRd1xicjabWMA/rnBcd9qxNEqDAxo/IOBNm7pBhyd3CxMnu3Gu2B+HiuhxL21fnvKPGbinVzqKigs4MQ==',key_name='tempest-keypair-1212091376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61a41f966cc44316a220e0379417d9f8',ramdisk_id='',reservation_id='r-pcfgj9w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-193187624',owner_user_name='tempest-VolumesAssistedSnapshotsTest-193187624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0d1c860d9814e588e14ba4ceefdac0a',uuid=e4a8f42b-da98-4652-be1f-393b790a87f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "address": "fa:16:3e:60:5d:1b", "network": {"id": "5f00031c-acd2-4226-84e3-c79acbb25528", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1468450531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a41f966cc44316a220e0379417d9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5a165c-65", "ovs_interfaceid": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Converting VIF {"id": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "address": "fa:16:3e:60:5d:1b", "network": {"id": "5f00031c-acd2-4226-84e3-c79acbb25528", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1468450531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a41f966cc44316a220e0379417d9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5a165c-65", "ovs_interfaceid": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:5d:1b,bridge_name='br-int',has_traffic_filtering=True,id=9c5a165c-656c-45af-833a-b69c3b2f73e0,network=Network(5f00031c-acd2-4226-84e3-c79acbb25528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5a165c-65') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG os_vif [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:5d:1b,bridge_name='br-int',has_traffic_filtering=True,id=9c5a165c-656c-45af-833a-b69c3b2f73e0,network=Network(5f00031c-acd2-4226-84e3-c79acbb25528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5a165c-65') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c5a165c-65, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c5a165c-65, col_values=(('external_ids', {'iface-id': '9c5a165c-656c-45af-833a-b69c3b2f73e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:5d:1b', 'vm-uuid': 'e4a8f42b-da98-4652-be1f-393b790a87f1'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:08 user nova-compute[72815]: INFO os_vif [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:5d:1b,bridge_name='br-int',has_traffic_filtering=True,id=9c5a165c-656c-45af-833a-b69c3b2f73e0,network=Network(5f00031c-acd2-4226-84e3-c79acbb25528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5a165c-65')
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] No VIF found with MAC fa:16:3e:60:5d:1b, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Successfully created port: 011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-ec07a9ee-73d1-452d-bb35-6467e556524e req-0335ad25-fd98-4e66-a412-86481966ec6f service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ec07a9ee-73d1-452d-bb35-6467e556524e req-0335ad25-fd98-4e66-a412-86481966ec6f service nova] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ec07a9ee-73d1-452d-bb35-6467e556524e req-0335ad25-fd98-4e66-a412-86481966ec6f service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ec07a9ee-73d1-452d-bb35-6467e556524e req-0335ad25-fd98-4e66-a412-86481966ec6f service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-ec07a9ee-73d1-452d-bb35-6467e556524e req-0335ad25-fd98-4e66-a412-86481966ec6f service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] No waiting events found dispatching network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:08 user nova-compute[72815]: WARNING nova.compute.manager [req-ec07a9ee-73d1-452d-bb35-6467e556524e req-0335ad25-fd98-4e66-a412-86481966ec6f service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received unexpected event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e for instance with vm_state active and task_state None.
Aug 17 19:54:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-1ad67959-cdde-4989-9ff0-cf48c227503b req-70829c5a-34a7-436a-9ff3-1ef02cd134a9 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Received event network-vif-plugged-71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ad67959-cdde-4989-9ff0-cf48c227503b req-70829c5a-34a7-436a-9ff3-1ef02cd134a9 service nova] Acquiring lock "969a1301-2014-4b22-8074-a0ac35136249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ad67959-cdde-4989-9ff0-cf48c227503b req-70829c5a-34a7-436a-9ff3-1ef02cd134a9 service nova] Lock "969a1301-2014-4b22-8074-a0ac35136249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ad67959-cdde-4989-9ff0-cf48c227503b req-70829c5a-34a7-436a-9ff3-1ef02cd134a9 service nova] Lock "969a1301-2014-4b22-8074-a0ac35136249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-1ad67959-cdde-4989-9ff0-cf48c227503b req-70829c5a-34a7-436a-9ff3-1ef02cd134a9 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] No waiting events found dispatching network-vif-plugged-71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:09 user nova-compute[72815]: WARNING nova.compute.manager [req-1ad67959-cdde-4989-9ff0-cf48c227503b req-70829c5a-34a7-436a-9ff3-1ef02cd134a9 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Received unexpected event network-vif-plugged-71991ae2-1663-4a4f-a0c6-ab4a271580c0 for instance with vm_state building and task_state spawning.
Aug 17 19:54:09 user nova-compute[72815]: DEBUG nova.network.neutron [req-0e813f8d-2d0d-4950-bf37-bb1f2dae7662 req-8b1bdb76-15b4-4b67-8906-5b809faff802 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Updated VIF entry in instance network info cache for port 9c5a165c-656c-45af-833a-b69c3b2f73e0. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:54:09 user nova-compute[72815]: DEBUG nova.network.neutron [req-0e813f8d-2d0d-4950-bf37-bb1f2dae7662 req-8b1bdb76-15b4-4b67-8906-5b809faff802 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Updating instance_info_cache with network_info: [{"id": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "address": "fa:16:3e:60:5d:1b", "network": {"id": "5f00031c-acd2-4226-84e3-c79acbb25528", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1468450531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a41f966cc44316a220e0379417d9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5a165c-65", "ovs_interfaceid": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:54:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0e813f8d-2d0d-4950-bf37-bb1f2dae7662 req-8b1bdb76-15b4-4b67-8906-5b809faff802 service nova] Releasing lock "refresh_cache-e4a8f42b-da98-4652-be1f-393b790a87f1" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:54:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:09 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.claims [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Claim successful on node user
Aug 17 19:54:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302050.3243432, 969a1301-2014-4b22-8074-a0ac35136249 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 969a1301-2014-4b22-8074-a0ac35136249] VM Resumed (Lifecycle Event)
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Instance spawned successfully.
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 969a1301-2014-4b22-8074-a0ac35136249] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302050.3304965, 969a1301-2014-4b22-8074-a0ac35136249 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 969a1301-2014-4b22-8074-a0ac35136249] VM Started (Lifecycle Event)
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Instance spawned successfully.
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.manager [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Took 10.45 seconds to spawn the instance on the hypervisor.
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 969a1301-2014-4b22-8074-a0ac35136249] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302050.448922, d00ba879-4c0f-4682-be36-8d61f44af9cf => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] VM Resumed (Lifecycle Event)
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302050.462246, d00ba879-4c0f-4682-be36-8d61f44af9cf => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] VM Started (Lifecycle Event)
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.manager [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Took 11.58 seconds to spawn the instance on the hypervisor.
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Successfully updated port: 011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquired lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-1b2e915f-877a-4985-b081-ff43c5e7fd56 req-a13a9443-d192-4355-b95b-28b05cfd2a69 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-changed-011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-1b2e915f-877a-4985-b081-ff43c5e7fd56 req-a13a9443-d192-4355-b95b-28b05cfd2a69 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Refreshing instance network info cache due to event network-changed-011707bb-905e-49f1-8517-e58e6907e383. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1b2e915f-877a-4985-b081-ff43c5e7fd56 req-a13a9443-d192-4355-b95b-28b05cfd2a69 service nova] Acquiring lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.manager [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Took 13.00 seconds to build instance.
Aug 17 19:54:10 user nova-compute[72815]: INFO nova.compute.manager [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Took 13.18 seconds to build instance.
Aug 17 19:54:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-757269e6-06df-4b74-821c-bdd41ddbf783 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "969a1301-2014-4b22-8074-a0ac35136249" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.171s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-914686b5-8bed-4875-9d7e-0480fa9c6bfc tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.331s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:10 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.942s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:54:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-92664613-5720-4d82-afe5-ad1f10891fef req-28bc9855-c6f6-4a19-b198-b90987eaf640 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Received event network-vif-plugged-71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92664613-5720-4d82-afe5-ad1f10891fef req-28bc9855-c6f6-4a19-b198-b90987eaf640 service nova] Acquiring lock "969a1301-2014-4b22-8074-a0ac35136249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92664613-5720-4d82-afe5-ad1f10891fef req-28bc9855-c6f6-4a19-b198-b90987eaf640 service nova] Lock "969a1301-2014-4b22-8074-a0ac35136249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92664613-5720-4d82-afe5-ad1f10891fef req-28bc9855-c6f6-4a19-b198-b90987eaf640 service nova] Lock "969a1301-2014-4b22-8074-a0ac35136249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-92664613-5720-4d82-afe5-ad1f10891fef req-28bc9855-c6f6-4a19-b198-b90987eaf640 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] No waiting events found dispatching network-vif-plugged-71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:11 user nova-compute[72815]: WARNING nova.compute.manager [req-92664613-5720-4d82-afe5-ad1f10891fef req-28bc9855-c6f6-4a19-b198-b90987eaf640 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Received unexpected event network-vif-plugged-71991ae2-1663-4a4f-a0c6-ab4a271580c0 for instance with vm_state active and task_state None.
Aug 17 19:54:11 user nova-compute[72815]: DEBUG nova.policy [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6773e7e8a2dc47238fa39e488eaad3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d2bd59500f4ad39fdb1a3860452b05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:54:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Creating image(s)
Aug 17 19:54:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "/opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "/opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "/opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.212s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.255s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Updating instance_info_cache with network_info: [{"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk 1073741824" returned: 0 in 0.080s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Releasing lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Instance network_info: |[{"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1b2e915f-877a-4985-b081-ff43c5e7fd56 req-a13a9443-d192-4355-b95b-28b05cfd2a69 service nova] Acquired lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.network.neutron [req-1b2e915f-877a-4985-b081-ff43c5e7fd56 req-a13a9443-d192-4355-b95b-28b05cfd2a69 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Refreshing network info cache for port 011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Start _get_guest_xml network_info=[{"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:54:12 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:54:12 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13917815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13917815',id=9,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlbsB/SL5V5htublsblE53rgHUrd9eZYybyL04+s6cojpdS2pEXlZxF8DNM1ntLrIb/vWy80DhnU321He3lWo9jYEzzJlKGMilORzFpyhwZX5aQj4c3XPI1rKA578fn/A==',key_name='tempest-keypair-559643765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8ba66c6a1bf494f867c7eec572d4880',ramdisk_id='',reservation_id='r-s5cxnqgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-80529303',owner_user_name='tempest-TaggedAttachmentsTest-80529303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a78dad1c02084db9b032efb86f7a503c',uuid=07f12446-7bbc-4b95-a79b-99d48fa23d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converting VIF {"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:31:8b,bridge_name='br-int',has_traffic_filtering=True,id=011707bb-905e-49f1-8517-e58e6907e383,network=Network(ac4b9ba9-7aff-47f2-ba0a-047652802f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011707bb-90') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lazy-loading 'pci_devices' on Instance uuid 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:54:12 user nova-compute[72815]:   <uuid>07f12446-7bbc-4b95-a79b-99d48fa23d63</uuid>
Aug 17 19:54:12 user nova-compute[72815]:   <name>instance-00000009</name>
Aug 17 19:54:12 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:54:12 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:54:12 user nova-compute[72815]:   <metadata>
Aug 17 19:54:12 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:54:12 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:54:12 user nova-compute[72815]:       <nova:name>tempest-device-tagging-server-13917815</nova:name>
Aug 17 19:54:12 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:54:12</nova:creationTime>
Aug 17 19:54:12 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:54:12 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:54:12 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:54:12 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:54:12 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:54:12 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:54:12 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:54:12 user nova-compute[72815]:       <nova:owner>
Aug 17 19:54:12 user nova-compute[72815]:         <nova:user uuid="a78dad1c02084db9b032efb86f7a503c">tempest-TaggedAttachmentsTest-80529303-project-member</nova:user>
Aug 17 19:54:12 user nova-compute[72815]:         <nova:project uuid="b8ba66c6a1bf494f867c7eec572d4880">tempest-TaggedAttachmentsTest-80529303</nova:project>
Aug 17 19:54:12 user nova-compute[72815]:       </nova:owner>
Aug 17 19:54:12 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:54:12 user nova-compute[72815]:       <nova:ports>
Aug 17 19:54:12 user nova-compute[72815]:         <nova:port uuid="011707bb-905e-49f1-8517-e58e6907e383">
Aug 17 19:54:12 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 19:54:12 user nova-compute[72815]:         </nova:port>
Aug 17 19:54:12 user nova-compute[72815]:       </nova:ports>
Aug 17 19:54:12 user nova-compute[72815]:     </nova:instance>
Aug 17 19:54:12 user nova-compute[72815]:   </metadata>
Aug 17 19:54:12 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:54:12 user nova-compute[72815]:     <system>
Aug 17 19:54:12 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:54:12 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:54:12 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:54:12 user nova-compute[72815]:       <entry name="serial">07f12446-7bbc-4b95-a79b-99d48fa23d63</entry>
Aug 17 19:54:12 user nova-compute[72815]:       <entry name="uuid">07f12446-7bbc-4b95-a79b-99d48fa23d63</entry>
Aug 17 19:54:12 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:54:12 user nova-compute[72815]:     </system>
Aug 17 19:54:12 user nova-compute[72815]:   </sysinfo>
Aug 17 19:54:12 user nova-compute[72815]:   <os>
Aug 17 19:54:12 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:54:12 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:54:12 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:54:12 user nova-compute[72815]:   </os>
Aug 17 19:54:12 user nova-compute[72815]:   <features>
Aug 17 19:54:12 user nova-compute[72815]:     <acpi/>
Aug 17 19:54:12 user nova-compute[72815]:     <apic/>
Aug 17 19:54:12 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:54:12 user nova-compute[72815]:   </features>
Aug 17 19:54:12 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:54:12 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:54:12 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:54:12 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:54:12 user nova-compute[72815]:   </clock>
Aug 17 19:54:12 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:54:12 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:54:12 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:54:12 user nova-compute[72815]:   </cpu>
Aug 17 19:54:12 user nova-compute[72815]:   <devices>
Aug 17 19:54:12 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:54:12 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:54:12 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk"/>
Aug 17 19:54:12 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:54:12 user nova-compute[72815]:     </disk>
Aug 17 19:54:12 user nova-compute[72815]:     <disk type="file" device="cdrom">
Aug 17 19:54:12 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 19:54:12 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk.config"/>
Aug 17 19:54:12 user nova-compute[72815]:       <target dev="hda" bus="ide"/>
Aug 17 19:54:12 user nova-compute[72815]:     </disk>
Aug 17 19:54:12 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:54:12 user nova-compute[72815]:       <mac address="fa:16:3e:86:31:8b"/>
Aug 17 19:54:12 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:54:12 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:54:12 user nova-compute[72815]:       <target dev="tap011707bb-90"/>
Aug 17 19:54:12 user nova-compute[72815]:     </interface>
Aug 17 19:54:12 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:54:12 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/console.log" append="off"/>
Aug 17 19:54:12 user nova-compute[72815]:     </serial>
Aug 17 19:54:12 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:54:12 user nova-compute[72815]:     <video>
Aug 17 19:54:12 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:54:12 user nova-compute[72815]:     </video>
Aug 17 19:54:12 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:54:12 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:54:12 user nova-compute[72815]:     </rng>
Aug 17 19:54:12 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:54:12 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:54:12 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:54:12 user nova-compute[72815]:     </memballoon>
Aug 17 19:54:12 user nova-compute[72815]:   </devices>
Aug 17 19:54:12 user nova-compute[72815]: </domain>
Aug 17 19:54:12 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13917815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13917815',id=9,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlbsB/SL5V5htublsblE53rgHUrd9eZYybyL04+s6cojpdS2pEXlZxF8DNM1ntLrIb/vWy80DhnU321He3lWo9jYEzzJlKGMilORzFpyhwZX5aQj4c3XPI1rKA578fn/A==',key_name='tempest-keypair-559643765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8ba66c6a1bf494f867c7eec572d4880',ramdisk_id='',reservation_id='r-s5cxnqgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-80529303',owner_user_name='tempest-TaggedAttachmentsTest-80529303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a78dad1c02084db9b032efb86f7a503c',uuid=07f12446-7bbc-4b95-a79b-99d48fa23d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converting VIF {"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:31:8b,bridge_name='br-int',has_traffic_filtering=True,id=011707bb-905e-49f1-8517-e58e6907e383,network=Network(ac4b9ba9-7aff-47f2-ba0a-047652802f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011707bb-90') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG os_vif [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:31:8b,bridge_name='br-int',has_traffic_filtering=True,id=011707bb-905e-49f1-8517-e58e6907e383,network=Network(ac4b9ba9-7aff-47f2-ba0a-047652802f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011707bb-90') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap011707bb-90, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap011707bb-90, col_values=(('external_ids', {'iface-id': '011707bb-905e-49f1-8517-e58e6907e383', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:31:8b', 'vm-uuid': '07f12446-7bbc-4b95-a79b-99d48fa23d63'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:54:12 user nova-compute[72815]: INFO os_vif [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:31:8b,bridge_name='br-int',has_traffic_filtering=True,id=011707bb-905e-49f1-8517-e58e6907e383,network=Network(ac4b9ba9-7aff-47f2-ba0a-047652802f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011707bb-90')
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.258s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] No BDM found with device name hda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] No VIF found with MAC fa:16:3e:86:31:8b, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:54:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Using config drive
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Cannot resize image /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lazy-loading 'migration_context' on Instance uuid 01fdb794-dc6b-412b-95e1-c6c80cb81ecf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Ensure instance console log exists: /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Creating config drive at /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk.config
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpepcocbjc {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpepcocbjc" returned: 0 in 0.198s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-1b2e915f-877a-4985-b081-ff43c5e7fd56 req-a13a9443-d192-4355-b95b-28b05cfd2a69 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Updated VIF entry in instance network info cache for port 011707bb-905e-49f1-8517-e58e6907e383. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-1b2e915f-877a-4985-b081-ff43c5e7fd56 req-a13a9443-d192-4355-b95b-28b05cfd2a69 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Updating instance_info_cache with network_info: [{"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1b2e915f-877a-4985-b081-ff43c5e7fd56 req-a13a9443-d192-4355-b95b-28b05cfd2a69 service nova] Releasing lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302053.260688, e4a8f42b-da98-4652-be1f-393b790a87f1 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:54:13 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] VM Resumed (Lifecycle Event)
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:54:13 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Instance spawned successfully.
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Successfully created port: a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:54:13 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302053.261435, e4a8f42b-da98-4652-be1f-393b790a87f1 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:54:13 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] VM Started (Lifecycle Event)
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:54:13 user nova-compute[72815]: INFO nova.compute.manager [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Took 10.71 seconds to spawn the instance on the hypervisor.
Aug 17 19:54:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:13 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:54:13 user nova-compute[72815]: INFO nova.compute.manager [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Took 11.87 seconds to build instance.
Aug 17 19:54:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a0b6f535-3b22-44c0-a0ad-4efc3caaa326 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.034s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:14 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Successfully updated port: a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:54:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "refresh_cache-01fdb794-dc6b-412b-95e1-c6c80cb81ecf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:54:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquired lock "refresh_cache-01fdb794-dc6b-412b-95e1-c6c80cb81ecf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:54:14 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-13126ac7-956b-461f-b0bf-e016110600c2 req-6f9dc104-1073-44f8-b959-436fc667887c service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Received event network-changed-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-13126ac7-956b-461f-b0bf-e016110600c2 req-6f9dc104-1073-44f8-b959-436fc667887c service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Refreshing instance network info cache due to event network-changed-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-13126ac7-956b-461f-b0bf-e016110600c2 req-6f9dc104-1073-44f8-b959-436fc667887c service nova] Acquiring lock "refresh_cache-01fdb794-dc6b-412b-95e1-c6c80cb81ecf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Updating instance_info_cache with network_info: [{"id": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "address": "fa:16:3e:7d:d0:02", "network": {"id": "c99b980b-310e-49e8-8ac8-03448305c844", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1208402457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d2bd59500f4ad39fdb1a3860452b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa57b3e59-1c", "ovs_interfaceid": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Releasing lock "refresh_cache-01fdb794-dc6b-412b-95e1-c6c80cb81ecf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Instance network_info: |[{"id": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "address": "fa:16:3e:7d:d0:02", "network": {"id": "c99b980b-310e-49e8-8ac8-03448305c844", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1208402457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d2bd59500f4ad39fdb1a3860452b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa57b3e59-1c", "ovs_interfaceid": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-13126ac7-956b-461f-b0bf-e016110600c2 req-6f9dc104-1073-44f8-b959-436fc667887c service nova] Acquired lock "refresh_cache-01fdb794-dc6b-412b-95e1-c6c80cb81ecf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.network.neutron [req-13126ac7-956b-461f-b0bf-e016110600c2 req-6f9dc104-1073-44f8-b959-436fc667887c service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Refreshing network info cache for port a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Start _get_guest_xml network_info=[{"id": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "address": "fa:16:3e:7d:d0:02", "network": {"id": "c99b980b-310e-49e8-8ac8-03448305c844", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1208402457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d2bd59500f4ad39fdb1a3860452b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa57b3e59-1c", "ovs_interfaceid": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:54:15 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:54:15 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:54:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1079196209',display_name='tempest-TestVolumeSwap-server-1079196209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1079196209',id=10,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrWv8XNSJtYGW5uJQVDf4U0jk1TgdAw4LjANy0zBOV01q/9q/QotNSZt+u6E6cOmyxsiD7WBmpsixSlN2jwoLFEWcGeKkKecVFlP15lAvSyxd/jm8Fnfs5eUp9rKypvjg==',key_name='tempest-keypair-1060654525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d2bd59500f4ad39fdb1a3860452b05',ramdisk_id='',reservation_id='r-dfg31nth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-391106170',owner_user_name='tempest-TestVolumeSwap-391106170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:54:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6773e7e8a2dc47238fa39e488eaad3c6',uuid=01fdb794-dc6b-412b-95e1-c6c80cb81ecf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "address": "fa:16:3e:7d:d0:02", "network": {"id": "c99b980b-310e-49e8-8ac8-03448305c844", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1208402457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d2bd59500f4ad39fdb1a3860452b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa57b3e59-1c", "ovs_interfaceid": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Converting VIF {"id": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "address": "fa:16:3e:7d:d0:02", "network": {"id": "c99b980b-310e-49e8-8ac8-03448305c844", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1208402457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d2bd59500f4ad39fdb1a3860452b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa57b3e59-1c", "ovs_interfaceid": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d0:02,bridge_name='br-int',has_traffic_filtering=True,id=a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5,network=Network(c99b980b-310e-49e8-8ac8-03448305c844),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa57b3e59-1c') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lazy-loading 'pci_devices' on Instance uuid 01fdb794-dc6b-412b-95e1-c6c80cb81ecf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:54:15 user nova-compute[72815]:   <uuid>01fdb794-dc6b-412b-95e1-c6c80cb81ecf</uuid>
Aug 17 19:54:15 user nova-compute[72815]:   <name>instance-0000000a</name>
Aug 17 19:54:15 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:54:15 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:54:15 user nova-compute[72815]:   <metadata>
Aug 17 19:54:15 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:54:15 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:54:15 user nova-compute[72815]:       <nova:name>tempest-TestVolumeSwap-server-1079196209</nova:name>
Aug 17 19:54:15 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:54:15</nova:creationTime>
Aug 17 19:54:15 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:54:15 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:54:15 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:54:15 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:54:15 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:54:15 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:54:15 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:54:15 user nova-compute[72815]:       <nova:owner>
Aug 17 19:54:15 user nova-compute[72815]:         <nova:user uuid="6773e7e8a2dc47238fa39e488eaad3c6">tempest-TestVolumeSwap-391106170-project-member</nova:user>
Aug 17 19:54:15 user nova-compute[72815]:         <nova:project uuid="a8d2bd59500f4ad39fdb1a3860452b05">tempest-TestVolumeSwap-391106170</nova:project>
Aug 17 19:54:15 user nova-compute[72815]:       </nova:owner>
Aug 17 19:54:15 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:54:15 user nova-compute[72815]:       <nova:ports>
Aug 17 19:54:15 user nova-compute[72815]:         <nova:port uuid="a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5">
Aug 17 19:54:15 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 19:54:15 user nova-compute[72815]:         </nova:port>
Aug 17 19:54:15 user nova-compute[72815]:       </nova:ports>
Aug 17 19:54:15 user nova-compute[72815]:     </nova:instance>
Aug 17 19:54:15 user nova-compute[72815]:   </metadata>
Aug 17 19:54:15 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:54:15 user nova-compute[72815]:     <system>
Aug 17 19:54:15 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:54:15 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:54:15 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:54:15 user nova-compute[72815]:       <entry name="serial">01fdb794-dc6b-412b-95e1-c6c80cb81ecf</entry>
Aug 17 19:54:15 user nova-compute[72815]:       <entry name="uuid">01fdb794-dc6b-412b-95e1-c6c80cb81ecf</entry>
Aug 17 19:54:15 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:54:15 user nova-compute[72815]:     </system>
Aug 17 19:54:15 user nova-compute[72815]:   </sysinfo>
Aug 17 19:54:15 user nova-compute[72815]:   <os>
Aug 17 19:54:15 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:54:15 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:54:15 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:54:15 user nova-compute[72815]:   </os>
Aug 17 19:54:15 user nova-compute[72815]:   <features>
Aug 17 19:54:15 user nova-compute[72815]:     <acpi/>
Aug 17 19:54:15 user nova-compute[72815]:     <apic/>
Aug 17 19:54:15 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:54:15 user nova-compute[72815]:   </features>
Aug 17 19:54:15 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:54:15 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:54:15 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:54:15 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:54:15 user nova-compute[72815]:   </clock>
Aug 17 19:54:15 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:54:15 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:54:15 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:54:15 user nova-compute[72815]:   </cpu>
Aug 17 19:54:15 user nova-compute[72815]:   <devices>
Aug 17 19:54:15 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:54:15 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:54:15 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk"/>
Aug 17 19:54:15 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:54:15 user nova-compute[72815]:     </disk>
Aug 17 19:54:15 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:54:15 user nova-compute[72815]:       <mac address="fa:16:3e:7d:d0:02"/>
Aug 17 19:54:15 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:54:15 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:54:15 user nova-compute[72815]:       <target dev="tapa57b3e59-1c"/>
Aug 17 19:54:15 user nova-compute[72815]:     </interface>
Aug 17 19:54:15 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:54:15 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/console.log" append="off"/>
Aug 17 19:54:15 user nova-compute[72815]:     </serial>
Aug 17 19:54:15 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:54:15 user nova-compute[72815]:     <video>
Aug 17 19:54:15 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:54:15 user nova-compute[72815]:     </video>
Aug 17 19:54:15 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:54:15 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:54:15 user nova-compute[72815]:     </rng>
Aug 17 19:54:15 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:54:15 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:54:15 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:54:15 user nova-compute[72815]:     </memballoon>
Aug 17 19:54:15 user nova-compute[72815]:   </devices>
Aug 17 19:54:15 user nova-compute[72815]: </domain>
Aug 17 19:54:15 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:54:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1079196209',display_name='tempest-TestVolumeSwap-server-1079196209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1079196209',id=10,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrWv8XNSJtYGW5uJQVDf4U0jk1TgdAw4LjANy0zBOV01q/9q/QotNSZt+u6E6cOmyxsiD7WBmpsixSlN2jwoLFEWcGeKkKecVFlP15lAvSyxd/jm8Fnfs5eUp9rKypvjg==',key_name='tempest-keypair-1060654525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d2bd59500f4ad39fdb1a3860452b05',ramdisk_id='',reservation_id='r-dfg31nth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-391106170',owner_user_name='tempest-TestVolumeSwap-391106170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:54:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6773e7e8a2dc47238fa39e488eaad3c6',uuid=01fdb794-dc6b-412b-95e1-c6c80cb81ecf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "address": "fa:16:3e:7d:d0:02", "network": {"id": "c99b980b-310e-49e8-8ac8-03448305c844", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1208402457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d2bd59500f4ad39fdb1a3860452b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa57b3e59-1c", "ovs_interfaceid": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Converting VIF {"id": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "address": "fa:16:3e:7d:d0:02", "network": {"id": "c99b980b-310e-49e8-8ac8-03448305c844", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1208402457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d2bd59500f4ad39fdb1a3860452b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa57b3e59-1c", "ovs_interfaceid": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d0:02,bridge_name='br-int',has_traffic_filtering=True,id=a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5,network=Network(c99b980b-310e-49e8-8ac8-03448305c844),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa57b3e59-1c') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG os_vif [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d0:02,bridge_name='br-int',has_traffic_filtering=True,id=a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5,network=Network(c99b980b-310e-49e8-8ac8-03448305c844),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa57b3e59-1c') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa57b3e59-1c, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa57b3e59-1c, col_values=(('external_ids', {'iface-id': 'a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:d0:02', 'vm-uuid': '01fdb794-dc6b-412b-95e1-c6c80cb81ecf'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:15 user nova-compute[72815]: INFO os_vif [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d0:02,bridge_name='br-int',has_traffic_filtering=True,id=a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5,network=Network(c99b980b-310e-49e8-8ac8-03448305c844),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa57b3e59-1c')
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:54:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] No VIF found with MAC fa:16:3e:7d:d0:02, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:54:16 user nova-compute[72815]: DEBUG nova.network.neutron [req-13126ac7-956b-461f-b0bf-e016110600c2 req-6f9dc104-1073-44f8-b959-436fc667887c service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Updated VIF entry in instance network info cache for port a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:54:16 user nova-compute[72815]: DEBUG nova.network.neutron [req-13126ac7-956b-461f-b0bf-e016110600c2 req-6f9dc104-1073-44f8-b959-436fc667887c service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Updating instance_info_cache with network_info: [{"id": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "address": "fa:16:3e:7d:d0:02", "network": {"id": "c99b980b-310e-49e8-8ac8-03448305c844", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1208402457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d2bd59500f4ad39fdb1a3860452b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa57b3e59-1c", "ovs_interfaceid": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:54:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-13126ac7-956b-461f-b0bf-e016110600c2 req-6f9dc104-1073-44f8-b959-436fc667887c service nova] Releasing lock "refresh_cache-01fdb794-dc6b-412b-95e1-c6c80cb81ecf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:54:16 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:54:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 19:54:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] There are 0 instances to clean {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 19:54:16 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:54:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 19:54:16 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302057.539942, 07f12446-7bbc-4b95-a79b-99d48fa23d63 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:54:17 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] VM Resumed (Lifecycle Event)
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:54:17 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Instance spawned successfully.
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:17 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302057.5434191, 07f12446-7bbc-4b95-a79b-99d48fa23d63 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:54:17 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] VM Started (Lifecycle Event)
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:54:17 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:54:17 user nova-compute[72815]: INFO nova.compute.manager [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Took 10.84 seconds to spawn the instance on the hypervisor.
Aug 17 19:54:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:17 user nova-compute[72815]: INFO nova.compute.manager [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Took 11.83 seconds to build instance.
Aug 17 19:54:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a58c5df-47bb-4749-b688-fc2cd874ea85 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.971s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:19 user nova-compute[72815]: DEBUG nova.compute.manager [req-c63659c8-43b2-4063-b0ae-1e0e57e3fda3 req-fabd8dd2-57f3-497d-b592-7d801ad215fc service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Received event network-vif-plugged-8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c63659c8-43b2-4063-b0ae-1e0e57e3fda3 req-fabd8dd2-57f3-497d-b592-7d801ad215fc service nova] Acquiring lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c63659c8-43b2-4063-b0ae-1e0e57e3fda3 req-fabd8dd2-57f3-497d-b592-7d801ad215fc service nova] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c63659c8-43b2-4063-b0ae-1e0e57e3fda3 req-fabd8dd2-57f3-497d-b592-7d801ad215fc service nova] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:19 user nova-compute[72815]: DEBUG nova.compute.manager [req-c63659c8-43b2-4063-b0ae-1e0e57e3fda3 req-fabd8dd2-57f3-497d-b592-7d801ad215fc service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] No waiting events found dispatching network-vif-plugged-8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:19 user nova-compute[72815]: WARNING nova.compute.manager [req-c63659c8-43b2-4063-b0ae-1e0e57e3fda3 req-fabd8dd2-57f3-497d-b592-7d801ad215fc service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Received unexpected event network-vif-plugged-8fe39d89-b180-4d36-aa58-5956cc68e1b9 for instance with vm_state active and task_state None.
Aug 17 19:54:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302060.6924193, 01fdb794-dc6b-412b-95e1-c6c80cb81ecf => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:54:20 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] VM Resumed (Lifecycle Event)
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:54:20 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Instance spawned successfully.
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:54:20 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302060.6972303, 01fdb794-dc6b-412b-95e1-c6c80cb81ecf => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:54:20 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] VM Started (Lifecycle Event)
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:54:20 user nova-compute[72815]: INFO nova.compute.manager [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Took 9.33 seconds to spawn the instance on the hypervisor.
Aug 17 19:54:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:54:20 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:54:20 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:54:20 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:54:21 user nova-compute[72815]: INFO nova.compute.manager [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Took 11.07 seconds to build instance.
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb58201-c33d-433e-81c1-c8bdd2559d0c tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.294s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Received event network-vif-plugged-8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] Acquiring lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] No waiting events found dispatching network-vif-plugged-8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:21 user nova-compute[72815]: WARNING nova.compute.manager [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Received unexpected event network-vif-plugged-8fe39d89-b180-4d36-aa58-5956cc68e1b9 for instance with vm_state active and task_state None.
Aug 17 19:54:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Received event network-vif-plugged-9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] Acquiring lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] No waiting events found dispatching network-vif-plugged-9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:21 user nova-compute[72815]: WARNING nova.compute.manager [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Received unexpected event network-vif-plugged-9c5a165c-656c-45af-833a-b69c3b2f73e0 for instance with vm_state active and task_state None.
Aug 17 19:54:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Received event network-vif-plugged-9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] Acquiring lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] No waiting events found dispatching network-vif-plugged-9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:21 user nova-compute[72815]: WARNING nova.compute.manager [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Received unexpected event network-vif-plugged-9c5a165c-656c-45af-833a-b69c3b2f73e0 for instance with vm_state active and task_state None.
Aug 17 19:54:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-vif-plugged-011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] No waiting events found dispatching network-vif-plugged-011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:21 user nova-compute[72815]: WARNING nova.compute.manager [req-0196f7a8-3886-43a2-b05d-0db12f4d2ce7 req-023a12e1-ab67-4cb1-8e95-7fd330c9a73d service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received unexpected event network-vif-plugged-011707bb-905e-49f1-8517-e58e6907e383 for instance with vm_state active and task_state None.
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.321s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG nova.compute.manager [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-vif-plugged-011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG nova.compute.manager [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] No waiting events found dispatching network-vif-plugged-011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:23 user nova-compute[72815]: WARNING nova.compute.manager [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received unexpected event network-vif-plugged-011707bb-905e-49f1-8517-e58e6907e383 for instance with vm_state active and task_state None.
Aug 17 19:54:23 user nova-compute[72815]: DEBUG nova.compute.manager [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Received event network-vif-plugged-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] Acquiring lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG nova.compute.manager [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] No waiting events found dispatching network-vif-plugged-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:23 user nova-compute[72815]: WARNING nova.compute.manager [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Received unexpected event network-vif-plugged-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 for instance with vm_state active and task_state None.
Aug 17 19:54:23 user nova-compute[72815]: DEBUG nova.compute.manager [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Received event network-vif-plugged-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] Acquiring lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG nova.compute.manager [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] No waiting events found dispatching network-vif-plugged-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:54:23 user nova-compute[72815]: WARNING nova.compute.manager [req-0f1cacb6-d933-4418-a2b0-c2bf8559e586 req-62f5b06d-808e-456e-9da5-a18425581f94 service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Received unexpected event network-vif-plugged-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 for instance with vm_state active and task_state None.
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:54:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:54:26 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:54:26 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:54:26 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7332MB free_disk=25.95151138305664GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:54:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:54:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance f5ba4305-b304-46d5-8069-37abab0e430d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 07d46763-1b59-4cce-9e10-e94d0efea05d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance d00ba879-4c0f-4682-be36-8d61f44af9cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 969a1301-2014-4b22-8074-a0ac35136249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance e4a8f42b-da98-4652-be1f-393b790a87f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 01fdb794-dc6b-412b-95e1-c6c80cb81ecf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Refreshing inventories for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Updating ProviderTree inventory for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Updating inventory in ProviderTree for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Refreshing aggregate associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, aggregates: None {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Refreshing trait associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:54:27 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:54:28 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:54:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.056s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:54:28 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:54:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:54:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:54:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-f5ba4305-b304-46d5-8069-37abab0e430d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:54:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-f5ba4305-b304-46d5-8069-37abab0e430d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:54:29 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:54:29 user nova-compute[72815]: DEBUG nova.objects.instance [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lazy-loading 'info_cache' on Instance uuid f5ba4305-b304-46d5-8069-37abab0e430d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:54:29 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Updating instance_info_cache with network_info: [{"id": "2730a429-8948-4303-8bba-ec78e215a242", "address": "fa:16:3e:da:27:de", "network": {"id": "67b207cc-b262-42b8-8f93-361fd48b7db6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-196588653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edbd7362f5e44004a7adeb21f40e8e38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730a429-89", "ovs_interfaceid": "2730a429-8948-4303-8bba-ec78e215a242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:54:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-f5ba4305-b304-46d5-8069-37abab0e430d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:54:30 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:54:30 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:54:30 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:54:30 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:54:30 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:54:30 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:54:30 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:54:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:54:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:55:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:55:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:55:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:55:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:55:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:55:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:55:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:55:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:55:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:55:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:55:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "f5ba4305-b304-46d5-8069-37abab0e430d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "f5ba4305-b304-46d5-8069-37abab0e430d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:18 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lazy-loading 'flavor' on Instance uuid f5ba4305-b304-46d5-8069-37abab0e430d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:55:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "f5ba4305-b304-46d5-8069-37abab0e430d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "f5ba4305-b304-46d5-8069-37abab0e430d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "f5ba4305-b304-46d5-8069-37abab0e430d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:18 user nova-compute[72815]: INFO nova.compute.manager [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Attaching volume e8af1fd8-4886-42ad-a069-feac31f84de3 to /dev/vdb
Aug 17 19:55:18 user nova-compute[72815]: DEBUG os_brick.utils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:55:18 user nova-compute[72815]: INFO oslo.privsep.daemon [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp6curulo5/privsep.sock']
Aug 17 19:55:18 user sudo[84266]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp6curulo5/privsep.sock
Aug 17 19:55:18 user sudo[84266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 19:55:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:55:19 user nova-compute[72815]: INFO nova.compute.manager [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] instance snapshotting
Aug 17 19:55:19 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:55:20 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Beginning live snapshot process
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json -f qcow2 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json -f qcow2" returned: 0 in 0.244s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json -f qcow2 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:20 user sudo[84266]: pam_unix(sudo:session): session closed for user root
Aug 17 19:55:20 user nova-compute[72815]: INFO oslo.privsep.daemon [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Spawned new privsep daemon via rootwrap
Aug 17 19:55:20 user nova-compute[72815]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 19:55:20 user nova-compute[72815]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 19:55:20 user nova-compute[72815]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 17 19:55:20 user nova-compute[72815]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84269
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c004974-bae7-4972-af43-09befabd3c61]: (2,) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8c36bb-b8dc-4597-b25f-81be6684dd51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:20 user nova-compute[72815]: WARNING os_brick.initiator.connectors.nvmeof [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caae61a-99ae-4932-870c-f38f48c5e736]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c874d5-ca4c-4284-ba6c-d2c0fcfe0864]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[284c0055-b382-4db3-b300-89ccbed0be89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphzbl2_vg/a70a2cfc2e894186b874ba58cc38d0f0.delta 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:55:20 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c95ce1-44e2-4908-8099-624300c0f461]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG os_brick.utils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] <== get_connector_properties: return (2483ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Updating existing volume attachment record: e559e778-ebdc-490d-a2eb-3b027c3b248d {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:55:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphzbl2_vg/a70a2cfc2e894186b874ba58cc38d0f0.delta 1073741824" returned: 0 in 0.052s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:20 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 19:55:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72815) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 17 19:55:20 user nova-compute[72815]: INFO nova.virt.libvirt.host [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] UEFI support detected
Aug 17 19:55:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:55:21 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:55:21 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:55:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:21 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:55:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] COPY block job progress, current cursor: 22675456 final cursor: 75497472 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:55:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:55:22 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 19:55:22 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 19:55:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphzbl2_vg/a70a2cfc2e894186b874ba58cc38d0f0.delta /opt/stack/data/nova/instances/snapshots/tmphzbl2_vg/a70a2cfc2e894186b874ba58cc38d0f0 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphzbl2_vg/a70a2cfc2e894186b874ba58cc38d0f0.delta /opt/stack/data/nova/instances/snapshots/tmphzbl2_vg/a70a2cfc2e894186b874ba58cc38d0f0" returned: 0 in 0.363s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:23 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Snapshot extracted, beginning image upload
Aug 17 19:55:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG nova.compute.manager [req-2f0d70bd-1c4b-46f8-85ac-8857dc6a4107 req-1ff1cb89-d5cb-40e6-9e63-7f3504ec639f service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Received event network-changed-d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG nova.compute.manager [req-2f0d70bd-1c4b-46f8-85ac-8857dc6a4107 req-1ff1cb89-d5cb-40e6-9e63-7f3504ec639f service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Refreshing instance network info cache due to event network-changed-d049d487-388c-408b-ada5-ae68e86585c3. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2f0d70bd-1c4b-46f8-85ac-8857dc6a4107 req-1ff1cb89-d5cb-40e6-9e63-7f3504ec639f service nova] Acquiring lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2f0d70bd-1c4b-46f8-85ac-8857dc6a4107 req-1ff1cb89-d5cb-40e6-9e63-7f3504ec639f service nova] Acquired lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG nova.network.neutron [req-2f0d70bd-1c4b-46f8-85ac-8857dc6a4107 req-1ff1cb89-d5cb-40e6-9e63-7f3504ec639f service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Refreshing network info cache for port d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG nova.network.neutron [req-2f0d70bd-1c4b-46f8-85ac-8857dc6a4107 req-1ff1cb89-d5cb-40e6-9e63-7f3504ec639f service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updated VIF entry in instance network info cache for port d049d487-388c-408b-ada5-ae68e86585c3. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG nova.network.neutron [req-2f0d70bd-1c4b-46f8-85ac-8857dc6a4107 req-1ff1cb89-d5cb-40e6-9e63-7f3504ec639f service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updating instance_info_cache with network_info: [{"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2f0d70bd-1c4b-46f8-85ac-8857dc6a4107 req-1ff1cb89-d5cb-40e6-9e63-7f3504ec639f service nova] Releasing lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:25 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Snapshot image upload complete
Aug 17 19:55:25 user nova-compute[72815]: INFO nova.compute.manager [None req-b8a2f1c0-6ef9-4cbc-9ee0-d3a779facf2d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Took 5.93 seconds to snapshot the instance on the hypervisor.
Aug 17 19:55:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:26 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:55:26 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:55:26 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=6859MB free_disk=25.793853759765625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:55:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance f5ba4305-b304-46d5-8069-37abab0e430d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 07d46763-1b59-4cce-9e10-e94d0efea05d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance d00ba879-4c0f-4682-be36-8d61f44af9cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 969a1301-2014-4b22-8074-a0ac35136249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance e4a8f42b-da98-4652-be1f-393b790a87f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 01fdb794-dc6b-412b-95e1-c6c80cb81ecf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:55:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:28 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:55:28 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:55:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:55:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:55:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:55:28 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Updating instance_info_cache with network_info: [{"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG nova.compute.manager [req-3201e883-496d-4493-8000-8f90cb7efdff req-ba33d832-5bc7-4f2a-a882-42c305504ab5 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-changed-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG nova.compute.manager [req-3201e883-496d-4493-8000-8f90cb7efdff req-ba33d832-5bc7-4f2a-a882-42c305504ab5 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Refreshing instance network info cache due to event network-changed-991f5622-2c12-4ea1-950b-19b55e89c57c. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3201e883-496d-4493-8000-8f90cb7efdff req-ba33d832-5bc7-4f2a-a882-42c305504ab5 service nova] Acquiring lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3201e883-496d-4493-8000-8f90cb7efdff req-ba33d832-5bc7-4f2a-a882-42c305504ab5 service nova] Acquired lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:55:29 user nova-compute[72815]: DEBUG nova.network.neutron [req-3201e883-496d-4493-8000-8f90cb7efdff req-ba33d832-5bc7-4f2a-a882-42c305504ab5 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Refreshing network info cache for port 991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:55:30 user nova-compute[72815]: DEBUG nova.network.neutron [req-3201e883-496d-4493-8000-8f90cb7efdff req-ba33d832-5bc7-4f2a-a882-42c305504ab5 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updated VIF entry in instance network info cache for port 991f5622-2c12-4ea1-950b-19b55e89c57c. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:55:30 user nova-compute[72815]: DEBUG nova.network.neutron [req-3201e883-496d-4493-8000-8f90cb7efdff req-ba33d832-5bc7-4f2a-a882-42c305504ab5 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updating instance_info_cache with network_info: [{"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:55:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3201e883-496d-4493-8000-8f90cb7efdff req-ba33d832-5bc7-4f2a-a882-42c305504ab5 service nova] Releasing lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:55:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:30 user nova-compute[72815]: DEBUG nova.compute.manager [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:55:30 user nova-compute[72815]: INFO nova.compute.manager [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] instance snapshotting
Aug 17 19:55:30 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Beginning live snapshot process
Aug 17 19:55:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json -f qcow2 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json -f qcow2 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json -f qcow2" returned: 0 in 0.266s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-7921a857-71af-4329-98d1-02faef4a0064 req-da007574-b01d-410a-b5d9-a550f1b70bbe service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-changed-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-7921a857-71af-4329-98d1-02faef4a0064 req-da007574-b01d-410a-b5d9-a550f1b70bbe service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Refreshing instance network info cache due to event network-changed-7d010d95-173c-44df-be70-170e3ca59b0e. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7921a857-71af-4329-98d1-02faef4a0064 req-da007574-b01d-410a-b5d9-a550f1b70bbe service nova] Acquiring lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7921a857-71af-4329-98d1-02faef4a0064 req-da007574-b01d-410a-b5d9-a550f1b70bbe service nova] Acquired lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG nova.network.neutron [req-7921a857-71af-4329-98d1-02faef4a0064 req-da007574-b01d-410a-b5d9-a550f1b70bbe service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Refreshing network info cache for port 7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjy799nxi/3b82330936714f328a38eedf10b3720c.delta 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjy799nxi/3b82330936714f328a38eedf10b3720c.delta 1073741824" returned: 0 in 0.047s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:31 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 19:55:32 user nova-compute[72815]: DEBUG nova.network.neutron [req-7921a857-71af-4329-98d1-02faef4a0064 req-da007574-b01d-410a-b5d9-a550f1b70bbe service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Updated VIF entry in instance network info cache for port 7d010d95-173c-44df-be70-170e3ca59b0e. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:55:32 user nova-compute[72815]: DEBUG nova.network.neutron [req-7921a857-71af-4329-98d1-02faef4a0064 req-da007574-b01d-410a-b5d9-a550f1b70bbe service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Updating instance_info_cache with network_info: [{"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:55:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7921a857-71af-4329-98d1-02faef4a0064 req-da007574-b01d-410a-b5d9-a550f1b70bbe service nova] Releasing lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:55:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] COPY block job progress, current cursor: 589824 final cursor: 75497472 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:55:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:55:32 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 19:55:33 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 19:55:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjy799nxi/3b82330936714f328a38eedf10b3720c.delta /opt/stack/data/nova/instances/snapshots/tmpjy799nxi/3b82330936714f328a38eedf10b3720c {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjy799nxi/3b82330936714f328a38eedf10b3720c.delta /opt/stack/data/nova/instances/snapshots/tmpjy799nxi/3b82330936714f328a38eedf10b3720c" returned: 0 in 0.291s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:33 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Snapshot extracted, beginning image upload
Aug 17 19:55:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connector [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Factory for ISCSI on None {{(pid=72815) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.011s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFgPtmuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:55:35 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:55:35 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:55:35 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:55:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ad98ed-51b3-4e01-9351-277e12b5ec35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:55:35 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc0f25f-8874-4714-9cf3-a7f35a2da217]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3] added
Aug 17 19:55:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62d04ba-090a-45b4-a71f-52243671298c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e5e55-ccec-4f64-bd52-f836220da4e4]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rFgPtmuD {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rFgPtmuD" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b688a1-c847-4e95-b104-1b8e92d16bf8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rFgPtmuD'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d075d3-8f2d-40be-b64d-e634ac01e808]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d4fce6-8833-4f7c-8f0b-bb4f9df2089f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:55:35 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:55:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:55:35 user nova-compute[72815]:  {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:55:35 user nova-compute[72815]: WARNING os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 19:55:35 user nova-compute[72815]: 
Aug 17 19:55:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bf81ec-7a17-4181-ba6b-b13c617e75fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3, portal: 172.16.0.220,3260]
Aug 17 19:55:36 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3, portal: 172.16.0.220,3260] successful.
Aug 17 19:55:36 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d746d4db-b7da-483a-88df-dbb2e5a984b1]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be49bb12-2c4e-4eef-ad4e-73942cbf313f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 (non-flash)
Aug 17 19:55:36 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 (non-flash)
Aug 17 19:55:36 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37eb22e-c4da-47c4-8eef-dbc327dcee69]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFgPtmuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:55:36 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Snapshot image upload complete
Aug 17 19:55:36 user nova-compute[72815]: INFO nova.compute.manager [None req-b55c0d87-f878-496d-b64f-9656dabe0aca tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Took 5.46 seconds to snapshot the instance on the hypervisor.
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG nova.objects.instance [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:36 user nova-compute[72815]: INFO nova.compute.manager [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Attaching volume 1c79b4ad-2ef9-42ee-8f37-aad0b223c4db to /dev/vdb
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.utils [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b68a9b-bc36-4936-b1fe-d07d25335264]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4593a4f1-7e13-44da-85ff-d39bff9a6607]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc8d971-5266-429c-bcf2-40d0038ff922]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb71530c-09ee-4233-8673-0444a7164049]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:55:36 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:55:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e45fd3-d472-4bd1-abf2-09dfde7de28a]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG os_brick.utils [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:55:36 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Updating existing volume attachment record: 8a98a6c3-1768-486f-9190-73532ab2f88e {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:55:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:55:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23162373661333163', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:55:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162373661333163', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:55:37 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lazy-loading 'flavor' on Instance uuid f5ba4305-b304-46d5-8069-37abab0e430d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:55:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:55:37 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:55:37 user nova-compute[72815]:   <source dev="/dev/sdb"/>
Aug 17 19:55:37 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:55:37 user nova-compute[72815]:   <serial>e8af1fd8-4886-42ad-a069-feac31f84de3</serial>
Aug 17 19:55:37 user nova-compute[72815]: </disk>
Aug 17 19:55:37 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:55:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:55:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:55:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] No VIF found with MAC fa:16:3e:da:27:de, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:55:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bbb7bc6f-85d4-4524-817a-e5dbb1e27616 tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "f5ba4305-b304-46d5-8069-37abab0e430d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.410s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "f5ba4305-b304-46d5-8069-37abab0e430d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "f5ba4305-b304-46d5-8069-37abab0e430d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:38 user nova-compute[72815]: INFO nova.compute.manager [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Terminating instance
Aug 17 19:55:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 19:55:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-92d86266-72e9-4ae6-80b6-66b3e8af1397 req-9053e344-1148-4870-b18d-8cbcba276f3a service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Received event network-vif-unplugged-2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92d86266-72e9-4ae6-80b6-66b3e8af1397 req-9053e344-1148-4870-b18d-8cbcba276f3a service nova] Acquiring lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92d86266-72e9-4ae6-80b6-66b3e8af1397 req-9053e344-1148-4870-b18d-8cbcba276f3a service nova] Lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92d86266-72e9-4ae6-80b6-66b3e8af1397 req-9053e344-1148-4870-b18d-8cbcba276f3a service nova] Lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-92d86266-72e9-4ae6-80b6-66b3e8af1397 req-9053e344-1148-4870-b18d-8cbcba276f3a service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] No waiting events found dispatching network-vif-unplugged-2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-92d86266-72e9-4ae6-80b6-66b3e8af1397 req-9053e344-1148-4870-b18d-8cbcba276f3a service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Received event network-vif-unplugged-2730a429-8948-4303-8bba-ec78e215a242 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Instance destroyed successfully.
Aug 17 19:55:39 user nova-compute[72815]: DEBUG nova.objects.instance [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lazy-loading 'resources' on Instance uuid f5ba4305-b304-46d5-8069-37abab0e430d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-419428525',display_name='tempest-DeleteServersTestJSON-server-419428525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-419428525',id=1,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:53:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edbd7362f5e44004a7adeb21f40e8e38',ramdisk_id='',reservation_id='r-jil7xhhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1125585776',owner_user_name='tempest-DeleteServersTestJSON-1125585776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:53:44Z,user_data=None,user_id='81819d9f8bc24f19b0702d986df7cf70',uuid=f5ba4305-b304-46d5-8069-37abab0e430d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2730a429-8948-4303-8bba-ec78e215a242", "address": "fa:16:3e:da:27:de", "network": {"id": "67b207cc-b262-42b8-8f93-361fd48b7db6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-196588653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edbd7362f5e44004a7adeb21f40e8e38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730a429-89", "ovs_interfaceid": "2730a429-8948-4303-8bba-ec78e215a242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Converting VIF {"id": "2730a429-8948-4303-8bba-ec78e215a242", "address": "fa:16:3e:da:27:de", "network": {"id": "67b207cc-b262-42b8-8f93-361fd48b7db6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-196588653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edbd7362f5e44004a7adeb21f40e8e38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730a429-89", "ovs_interfaceid": "2730a429-8948-4303-8bba-ec78e215a242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:27:de,bridge_name='br-int',has_traffic_filtering=True,id=2730a429-8948-4303-8bba-ec78e215a242,network=Network(67b207cc-b262-42b8-8f93-361fd48b7db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2730a429-89') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_vif [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:27:de,bridge_name='br-int',has_traffic_filtering=True,id=2730a429-8948-4303-8bba-ec78e215a242,network=Network(67b207cc-b262-42b8-8f93-361fd48b7db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2730a429-89') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2730a429-89, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:39 user nova-compute[72815]: INFO os_vif [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:27:de,bridge_name='br-int',has_traffic_filtering=True,id=2730a429-8948-4303-8bba-ec78e215a242,network=Network(67b207cc-b262-42b8-8f93-361fd48b7db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2730a429-89')
Aug 17 19:55:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFgPtmuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:55:39 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77fb064-8226-454b-946c-f8f19d127e64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[998d3e0b-e4d1-460b-9a65-43b6be4c8aee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 (non-flash)
Aug 17 19:55:39 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 (non-flash)
Aug 17 19:55:39 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b41f3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3'): ({'sdb'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Removing single pathed devices sdb {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7529eecd-f477-4066-b77e-da0cf3dcfb71]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1753784-c6d8-48a6-a1c7-37b9a6ae07b4]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Flushing IO for device /dev/sdb {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a058f380-11b8-4c0e-b0ac-9dd20d6efa2f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bc961f-3c92-4989-b814-cf187f2b6df1]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[422d833c-4ca1-4226-b83f-c6834d3bb944]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eea6523-2fba-4ebe-b3c4-45489979ab91]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3, portal: 172.16.0.220,3260]
Aug 17 19:55:39 user nova-compute[72815]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3, portal: 172.16.0.220,3260] successful.
Aug 17 19:55:39 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8af1fd8-4886-42ad-a069-feac31f84de3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b187772-9bb2-4bf7-ba57-225b645ef379]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] <== disconnect_volume: return (268ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:55:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:55:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Deleting instance files /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d_del
Aug 17 19:55:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Deletion of /opt/stack/data/nova/instances/f5ba4305-b304-46d5-8069-37abab0e430d_del complete
Aug 17 19:55:40 user nova-compute[72815]: INFO nova.compute.manager [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 17 19:55:40 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 19:55:40 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 19:55:40 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 19:55:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:40 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:55:41 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Took 0.98 seconds to deallocate network for instance.
Aug 17 19:55:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-9a2d16d4-acf6-432b-9b2f-4a5910dad723 req-20511c95-b650-4566-b0c3-b09daaf37efe service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Received event network-vif-plugged-2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:55:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9a2d16d4-acf6-432b-9b2f-4a5910dad723 req-20511c95-b650-4566-b0c3-b09daaf37efe service nova] Acquiring lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9a2d16d4-acf6-432b-9b2f-4a5910dad723 req-20511c95-b650-4566-b0c3-b09daaf37efe service nova] Lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9a2d16d4-acf6-432b-9b2f-4a5910dad723 req-20511c95-b650-4566-b0c3-b09daaf37efe service nova] Lock "f5ba4305-b304-46d5-8069-37abab0e430d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-9a2d16d4-acf6-432b-9b2f-4a5910dad723 req-20511c95-b650-4566-b0c3-b09daaf37efe service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] No waiting events found dispatching network-vif-plugged-2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:55:41 user nova-compute[72815]: WARNING nova.compute.manager [req-9a2d16d4-acf6-432b-9b2f-4a5910dad723 req-20511c95-b650-4566-b0c3-b09daaf37efe service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Received unexpected event network-vif-plugged-2730a429-8948-4303-8bba-ec78e215a242 for instance with vm_state active and task_state deleting.
Aug 17 19:55:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-9a2d16d4-acf6-432b-9b2f-4a5910dad723 req-20511c95-b650-4566-b0c3-b09daaf37efe service nova] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Received event network-vif-deleted-2730a429-8948-4303-8bba-ec78e215a242 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:55:41 user nova-compute[72815]: INFO nova.compute.manager [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Took 0.77 seconds to detach 1 volumes for instance.
Aug 17 19:55:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:42 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:55:42 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:55:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:42 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Deleted allocations for instance f5ba4305-b304-46d5-8069-37abab0e430d
Aug 17 19:55:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ca1bb30c-e066-4373-b000-202e7821102c tempest-DeleteServersTestJSON-1125585776 tempest-DeleteServersTestJSON-1125585776-project-member] Lock "f5ba4305-b304-46d5-8069-37abab0e430d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.544s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMXxRwDl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:55:47 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:55:47 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:55:47 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d81a19-db0f-411d-a41b-900571d34813]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:55:47 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc03c12e-7005-4c1c-ad8b-5b52d1e558dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db] added
Aug 17 19:55:47 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ae78fa-8a2e-4eac-8730-50abee326343]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82be5de-04fa-4a76-afe0-c1e48266bd59]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMXxRwDl {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMXxRwDl" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad3404f-2c63-43e5-a7cd-c9ba649c8b97]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VMXxRwDl'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c3e80c-1636-4861-acab-c068cab53498]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01a56b6-1a11-49e1-b922-57ecf8161589]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:55:47 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:55:47 user nova-compute[72815]:  {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:55:47 user nova-compute[72815]: WARNING os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 19:55:47 user nova-compute[72815]: 
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a388b6a4-3cc9-402a-abc9-d857f0f6c54a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260]
Aug 17 19:55:47 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260] successful.
Aug 17 19:55:47 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86d0690-1f7d-42f0-a336-b78fc3dbdf52]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d8c15d-1b25-486c-8197-b9c698392920]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:55:47 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:55:47 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[82845118-a419-4de0-a269-d12b0630d715]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:55:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMXxRwDl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-05bcce25-1196-4a41-905b-2a6d988704a4 req-e96d5a04-299b-407a-b861-383a0f115ff3 service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Received event network-changed-8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-05bcce25-1196-4a41-905b-2a6d988704a4 req-e96d5a04-299b-407a-b861-383a0f115ff3 service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Refreshing instance network info cache due to event network-changed-8fe39d89-b180-4d36-aa58-5956cc68e1b9. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-05bcce25-1196-4a41-905b-2a6d988704a4 req-e96d5a04-299b-407a-b861-383a0f115ff3 service nova] Acquiring lock "refresh_cache-d00ba879-4c0f-4682-be36-8d61f44af9cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-05bcce25-1196-4a41-905b-2a6d988704a4 req-e96d5a04-299b-407a-b861-383a0f115ff3 service nova] Acquired lock "refresh_cache-d00ba879-4c0f-4682-be36-8d61f44af9cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG nova.network.neutron [req-05bcce25-1196-4a41-905b-2a6d988704a4 req-e96d5a04-299b-407a-b861-383a0f115ff3 service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Refreshing network info cache for port 8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-b2514817-f230-432f-84f5-8237a4143975 req-fa93c0e3-4f00-41a5-b886-d22efec55147 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Received event network-changed-71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-b2514817-f230-432f-84f5-8237a4143975 req-fa93c0e3-4f00-41a5-b886-d22efec55147 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Refreshing instance network info cache due to event network-changed-71991ae2-1663-4a4f-a0c6-ab4a271580c0. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b2514817-f230-432f-84f5-8237a4143975 req-fa93c0e3-4f00-41a5-b886-d22efec55147 service nova] Acquiring lock "refresh_cache-969a1301-2014-4b22-8074-a0ac35136249" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b2514817-f230-432f-84f5-8237a4143975 req-fa93c0e3-4f00-41a5-b886-d22efec55147 service nova] Acquired lock "refresh_cache-969a1301-2014-4b22-8074-a0ac35136249" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG nova.network.neutron [req-b2514817-f230-432f-84f5-8237a4143975 req-fa93c0e3-4f00-41a5-b886-d22efec55147 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Refreshing network info cache for port 71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26538353632323238', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538353632323238', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG nova.objects.instance [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:55:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:55:48 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:55:48 user nova-compute[72815]:   <source dev="/dev/sdb"/>
Aug 17 19:55:48 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:55:48 user nova-compute[72815]:   <serial>1c79b4ad-2ef9-42ee-8f37-aad0b223c4db</serial>
Aug 17 19:55:48 user nova-compute[72815]: </disk>
Aug 17 19:55:48 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No VIF found with MAC fa:16:3e:ef:cb:33, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG nova.network.neutron [req-05bcce25-1196-4a41-905b-2a6d988704a4 req-e96d5a04-299b-407a-b861-383a0f115ff3 service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Updated VIF entry in instance network info cache for port 8fe39d89-b180-4d36-aa58-5956cc68e1b9. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG nova.network.neutron [req-05bcce25-1196-4a41-905b-2a6d988704a4 req-e96d5a04-299b-407a-b861-383a0f115ff3 service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Updating instance_info_cache with network_info: [{"id": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "address": "fa:16:3e:c1:d6:5f", "network": {"id": "cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1059060149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cab7108e8ee94ce5be59f7860980d489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe39d89-b1", "ovs_interfaceid": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-05bcce25-1196-4a41-905b-2a6d988704a4 req-e96d5a04-299b-407a-b861-383a0f115ff3 service nova] Releasing lock "refresh_cache-d00ba879-4c0f-4682-be36-8d61f44af9cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG nova.network.neutron [req-b2514817-f230-432f-84f5-8237a4143975 req-fa93c0e3-4f00-41a5-b886-d22efec55147 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Updated VIF entry in instance network info cache for port 71991ae2-1663-4a4f-a0c6-ab4a271580c0. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG nova.network.neutron [req-b2514817-f230-432f-84f5-8237a4143975 req-fa93c0e3-4f00-41a5-b886-d22efec55147 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Updating instance_info_cache with network_info: [{"id": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "address": "fa:16:3e:e1:b7:04", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71991ae2-16", "ovs_interfaceid": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b2514817-f230-432f-84f5-8237a4143975 req-fa93c0e3-4f00-41a5-b886-d22efec55147 service nova] Releasing lock "refresh_cache-969a1301-2014-4b22-8074-a0ac35136249" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47b945cd-2a8a-4e3b-960e-69229ee278e7 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.897s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c3a05317-7a00-4a21-8fe9-3faed37f9175 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c3a05317-7a00-4a21-8fe9-3faed37f9175 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-c3a05317-7a00-4a21-8fe9-3faed37f9175 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-c3a05317-7a00-4a21-8fe9-3faed37f9175 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72815) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG nova.objects.instance [None req-c3a05317-7a00-4a21-8fe9-3faed37f9175 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:55:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-59f55800-4102-48a3-bfd5-b0d88fe705c9 req-9eea7cf0-66e7-43e0-9ee3-3202ec227d59 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-unplugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:55:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-59f55800-4102-48a3-bfd5-b0d88fe705c9 req-9eea7cf0-66e7-43e0-9ee3-3202ec227d59 service nova] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-59f55800-4102-48a3-bfd5-b0d88fe705c9 req-9eea7cf0-66e7-43e0-9ee3-3202ec227d59 service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-59f55800-4102-48a3-bfd5-b0d88fe705c9 req-9eea7cf0-66e7-43e0-9ee3-3202ec227d59 service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-59f55800-4102-48a3-bfd5-b0d88fe705c9 req-9eea7cf0-66e7-43e0-9ee3-3202ec227d59 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] No waiting events found dispatching network-vif-unplugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:55:50 user nova-compute[72815]: WARNING nova.compute.manager [req-59f55800-4102-48a3-bfd5-b0d88fe705c9 req-9eea7cf0-66e7-43e0-9ee3-3202ec227d59 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received unexpected event network-vif-unplugged-7d010d95-173c-44df-be70-170e3ca59b0e for instance with vm_state active and task_state powering-off.
Aug 17 19:55:50 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance destroyed successfully.
Aug 17 19:55:50 user nova-compute[72815]: DEBUG nova.compute.manager [None req-c3a05317-7a00-4a21-8fe9-3faed37f9175 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:55:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c3a05317-7a00-4a21-8fe9-3faed37f9175 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.011s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-be1a7b1e-edaa-4f6f-9df6-f8c820da914c req-f48601b6-8eb8-4ac5-9cfb-527c3a044c2a service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:55:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-be1a7b1e-edaa-4f6f-9df6-f8c820da914c req-f48601b6-8eb8-4ac5-9cfb-527c3a044c2a service nova] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-be1a7b1e-edaa-4f6f-9df6-f8c820da914c req-f48601b6-8eb8-4ac5-9cfb-527c3a044c2a service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-be1a7b1e-edaa-4f6f-9df6-f8c820da914c req-f48601b6-8eb8-4ac5-9cfb-527c3a044c2a service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-be1a7b1e-edaa-4f6f-9df6-f8c820da914c req-f48601b6-8eb8-4ac5-9cfb-527c3a044c2a service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] No waiting events found dispatching network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:55:52 user nova-compute[72815]: WARNING nova.compute.manager [req-be1a7b1e-edaa-4f6f-9df6-f8c820da914c req-f48601b6-8eb8-4ac5-9cfb-527c3a044c2a service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received unexpected event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e for instance with vm_state stopped and task_state None.
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Acquiring lock "e4a8f42b-da98-4652-be1f-393b790a87f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG nova.objects.instance [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lazy-loading 'flavor' on Instance uuid e4a8f42b-da98-4652-be1f-393b790a87f1 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG nova.objects.instance [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lazy-loading 'flavor' on Instance uuid d00ba879-4c0f-4682-be36-8d61f44af9cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "969a1301-2014-4b22-8074-a0ac35136249" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "969a1301-2014-4b22-8074-a0ac35136249" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG nova.objects.instance [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lazy-loading 'flavor' on Instance uuid 969a1301-2014-4b22-8074-a0ac35136249 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "969a1301-2014-4b22-8074-a0ac35136249" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:53 user nova-compute[72815]: INFO nova.compute.manager [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Attaching volume 224da194-b3e5-4961-bb70-0d4b091c1eea to /dev/sdc
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Acquiring lock "e4a8f42b-da98-4652-be1f-393b790a87f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:53 user nova-compute[72815]: INFO nova.compute.manager [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Attaching volume 2b4d17c3-df66-490e-bc27-7e04b83559bb to /dev/vdb
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "969a1301-2014-4b22-8074-a0ac35136249" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "969a1301-2014-4b22-8074-a0ac35136249" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:53 user nova-compute[72815]: INFO nova.compute.manager [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Attaching volume 25520b69-5198-4f5a-8f55-73e72976b250 to /dev/vdb
Aug 17 19:55:53 user nova-compute[72815]: DEBUG os_brick.utils [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG os_brick.utils [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG os_brick.utils [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d8e640-5fe0-4f58-b852-86293014ac97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[40903b6c-2ac4-4ef9-b2f4-eb6129e4a939]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb13d19-f380-4ca4-9d8e-04f4e2df1e2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec33fd0-687b-4695-a5af-5dda8c6d75db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[815ec794-d27d-49cc-a768-239ded772ea4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d3e093-987d-4d7c-9792-33964a980445]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83e70f7-ce09-40ad-b997-17b938fd98e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fd7372-1d1d-4ead-9a6c-feb9c70421bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ba3018-a115-4841-b09b-ba9824c56eac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea40ebac-841a-479b-9fb2-d4f28c24d6b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aacaed-648b-4bb1-8339-6d5cdc6b3bae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:55:53 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[58342bca-58d7-495c-9c95-629a0fcc9be9]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c841250-9472-4b44-8c0f-1826b3cb10e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:55:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:55:54 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:55:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aa8a55-26a7-4d4e-90dd-19eb61a775f2]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.utils [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] <== get_connector_properties: return (233ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Updating existing volume attachment record: 5a5c07c4-2749-4b3a-8bfc-12b6da7e6e27 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.utils [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] <== get_connector_properties: return (245ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Updating existing volume attachment record: cc6155b3-d9c6-4fc0-93c4-79022c7b6220 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:55:54 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:55:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a925da-a104-41b8-a898-4cb83ff18951]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG os_brick.utils [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] <== get_connector_properties: return (263ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Updating existing volume attachment record: 9cb5d37a-b48b-4ad8-bbdb-b756afc6067a {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302139.6430297, f5ba4305-b304-46d5-8069-37abab0e430d => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:55:54 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] VM Stopped (Lifecycle Event)
Aug 17 19:55:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d849f66e-8458-4039-bd5b-07c63d57a980 None None] [instance: f5ba4305-b304-46d5-8069-37abab0e430d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-ca2148ae-8e62-4eba-b4d3-d8ff10167dce req-d548e0af-a6c5-4e05-86e0-a467af6e3fc8 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Received event network-changed-9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-ca2148ae-8e62-4eba-b4d3-d8ff10167dce req-d548e0af-a6c5-4e05-86e0-a467af6e3fc8 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Refreshing instance network info cache due to event network-changed-9c5a165c-656c-45af-833a-b69c3b2f73e0. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ca2148ae-8e62-4eba-b4d3-d8ff10167dce req-d548e0af-a6c5-4e05-86e0-a467af6e3fc8 service nova] Acquiring lock "refresh_cache-e4a8f42b-da98-4652-be1f-393b790a87f1" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ca2148ae-8e62-4eba-b4d3-d8ff10167dce req-d548e0af-a6c5-4e05-86e0-a467af6e3fc8 service nova] Acquired lock "refresh_cache-e4a8f42b-da98-4652-be1f-393b790a87f1" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:55:54 user nova-compute[72815]: DEBUG nova.network.neutron [req-ca2148ae-8e62-4eba-b4d3-d8ff10167dce req-d548e0af-a6c5-4e05-86e0-a467af6e3fc8 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Refreshing network info cache for port 9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:55:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-ca2148ae-8e62-4eba-b4d3-d8ff10167dce req-d548e0af-a6c5-4e05-86e0-a467af6e3fc8 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Updated VIF entry in instance network info cache for port 9c5a165c-656c-45af-833a-b69c3b2f73e0. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:55:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-ca2148ae-8e62-4eba-b4d3-d8ff10167dce req-d548e0af-a6c5-4e05-86e0-a467af6e3fc8 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Updating instance_info_cache with network_info: [{"id": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "address": "fa:16:3e:60:5d:1b", "network": {"id": "5f00031c-acd2-4226-84e3-c79acbb25528", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1468450531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a41f966cc44316a220e0379417d9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5a165c-65", "ovs_interfaceid": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:55:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ca2148ae-8e62-4eba-b4d3-d8ff10167dce req-d548e0af-a6c5-4e05-86e0-a467af6e3fc8 service nova] Releasing lock "refresh_cache-e4a8f42b-da98-4652-be1f-393b790a87f1" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:55:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-89d4d721-1345-4a1d-8db2-f1040368760e req-2d12fa4b-aabb-4dac-b347-9aa75af77d07 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-changed-011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-89d4d721-1345-4a1d-8db2-f1040368760e req-2d12fa4b-aabb-4dac-b347-9aa75af77d07 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Refreshing instance network info cache due to event network-changed-011707bb-905e-49f1-8517-e58e6907e383. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-89d4d721-1345-4a1d-8db2-f1040368760e req-2d12fa4b-aabb-4dac-b347-9aa75af77d07 service nova] Acquiring lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-89d4d721-1345-4a1d-8db2-f1040368760e req-2d12fa4b-aabb-4dac-b347-9aa75af77d07 service nova] Acquired lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-89d4d721-1345-4a1d-8db2-f1040368760e req-2d12fa4b-aabb-4dac-b347-9aa75af77d07 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Refreshing network info cache for port 011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "interface-07f12446-7bbc-4b95-a79b-99d48fa23d63-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "interface-07f12446-7bbc-4b95-a79b-99d48fa23d63-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG nova.objects.instance [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lazy-loading 'flavor' on Instance uuid 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-89d4d721-1345-4a1d-8db2-f1040368760e req-2d12fa4b-aabb-4dac-b347-9aa75af77d07 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Updated VIF entry in instance network info cache for port 011707bb-905e-49f1-8517-e58e6907e383. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-89d4d721-1345-4a1d-8db2-f1040368760e req-2d12fa4b-aabb-4dac-b347-9aa75af77d07 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Updating instance_info_cache with network_info: [{"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-89d4d721-1345-4a1d-8db2-f1040368760e req-2d12fa4b-aabb-4dac-b347-9aa75af77d07 service nova] Releasing lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG nova.objects.instance [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lazy-loading 'pci_requests' on Instance uuid 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:55:57 user nova-compute[72815]: DEBUG nova.network.neutron [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:55:58 user nova-compute[72815]: DEBUG nova.policy [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a78dad1c02084db9b032efb86f7a503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba66c6a1bf494f867c7eec572d4880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:55:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:55:58 user nova-compute[72815]: DEBUG nova.network.neutron [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Successfully created port: 1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:55:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Successfully updated port: 1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:56:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquired lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:56:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-9cdcedeb-c962-422c-9efa-0781e160dce5 req-2cde7db8-e4f9-48bc-9ac9-c54c7de1826b service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-changed-1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-9cdcedeb-c962-422c-9efa-0781e160dce5 req-2cde7db8-e4f9-48bc-9ac9-c54c7de1826b service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Refreshing instance network info cache due to event network-changed-1c8db3b8-c66d-4904-b304-7a60777894e2. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:56:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9cdcedeb-c962-422c-9efa-0781e160dce5 req-2cde7db8-e4f9-48bc-9ac9-c54c7de1826b service nova] Acquiring lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Updating instance_info_cache with network_info: [{"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Releasing lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9cdcedeb-c962-422c-9efa-0781e160dce5 req-2cde7db8-e4f9-48bc-9ac9-c54c7de1826b service nova] Acquired lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG nova.network.neutron [req-9cdcedeb-c962-422c-9efa-0781e160dce5 req-2cde7db8-e4f9-48bc-9ac9-c54c7de1826b service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Refreshing network info cache for port 1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13917815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13917815',id=9,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlbsB/SL5V5htublsblE53rgHUrd9eZYybyL04+s6cojpdS2pEXlZxF8DNM1ntLrIb/vWy80DhnU321He3lWo9jYEzzJlKGMilORzFpyhwZX5aQj4c3XPI1rKA578fn/A==',key_name='tempest-keypair-559643765',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:54:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b8ba66c6a1bf494f867c7eec572d4880',ramdisk_id='',reservation_id='r-s5cxnqgd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-80529303',owner_user_name='tempest-TaggedAttachmentsTest-80529303-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a78dad1c02084db9b032efb86f7a503c',uuid=07f12446-7bbc-4b95-a79b-99d48fa23d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converting VIF {"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=1c8db3b8-c66d-4904-b304-7a60777894e2,network=Network(377fc621-e91d-4e06-b7b0-875b12adc28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8db3b8-c6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG os_vif [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=1c8db3b8-c66d-4904-b304-7a60777894e2,network=Network(377fc621-e91d-4e06-b7b0-875b12adc28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8db3b8-c6') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c8db3b8-c6, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c8db3b8-c6, col_values=(('external_ids', {'iface-id': '1c8db3b8-c66d-4904-b304-7a60777894e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:4e:fb', 'vm-uuid': '07f12446-7bbc-4b95-a79b-99d48fa23d63'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:03 user nova-compute[72815]: INFO os_vif [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=1c8db3b8-c66d-4904-b304-7a60777894e2,network=Network(377fc621-e91d-4e06-b7b0-875b12adc28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8db3b8-c6')
Aug 17 19:56:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13917815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13917815',id=9,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlbsB/SL5V5htublsblE53rgHUrd9eZYybyL04+s6cojpdS2pEXlZxF8DNM1ntLrIb/vWy80DhnU321He3lWo9jYEzzJlKGMilORzFpyhwZX5aQj4c3XPI1rKA578fn/A==',key_name='tempest-keypair-559643765',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:54:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b8ba66c6a1bf494f867c7eec572d4880',ramdisk_id='',reservation_id='r-s5cxnqgd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-80529303',owner_user_name='tempest-TaggedAttachmentsTest-80529303-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a78dad1c02084db9b032efb86f7a503c',uuid=07f12446-7bbc-4b95-a79b-99d48fa23d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converting VIF {"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=1c8db3b8-c66d-4904-b304-7a60777894e2,network=Network(377fc621-e91d-4e06-b7b0-875b12adc28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8db3b8-c6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] attach device xml: <interface type="ethernet">
Aug 17 19:56:03 user nova-compute[72815]:   <mac address="fa:16:3e:27:4e:fb"/>
Aug 17 19:56:03 user nova-compute[72815]:   <model type="virtio"/>
Aug 17 19:56:03 user nova-compute[72815]:   <mtu size="1442"/>
Aug 17 19:56:03 user nova-compute[72815]:   <target dev="tap1c8db3b8-c6"/>
Aug 17 19:56:03 user nova-compute[72815]: </interface>
Aug 17 19:56:03 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:56:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] No BDM found with device name hda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] No VIF found with MAC fa:16:3e:86:31:8b, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:56:04 user nova-compute[72815]:   <nova:package version="0.0.0"/>
Aug 17 19:56:04 user nova-compute[72815]:   <nova:name>tempest-device-tagging-server-13917815</nova:name>
Aug 17 19:56:04 user nova-compute[72815]:   <nova:creationTime>2023-08-17 19:56:04</nova:creationTime>
Aug 17 19:56:04 user nova-compute[72815]:   <nova:flavor name="m1.tiny">
Aug 17 19:56:04 user nova-compute[72815]:     <nova:memory>512</nova:memory>
Aug 17 19:56:04 user nova-compute[72815]:     <nova:disk>1</nova:disk>
Aug 17 19:56:04 user nova-compute[72815]:     <nova:swap>0</nova:swap>
Aug 17 19:56:04 user nova-compute[72815]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:56:04 user nova-compute[72815]:     <nova:vcpus>1</nova:vcpus>
Aug 17 19:56:04 user nova-compute[72815]:   </nova:flavor>
Aug 17 19:56:04 user nova-compute[72815]:   <nova:owner>
Aug 17 19:56:04 user nova-compute[72815]:     <nova:user uuid="a78dad1c02084db9b032efb86f7a503c">tempest-TaggedAttachmentsTest-80529303-project-member</nova:user>
Aug 17 19:56:04 user nova-compute[72815]:     <nova:project uuid="b8ba66c6a1bf494f867c7eec572d4880">tempest-TaggedAttachmentsTest-80529303</nova:project>
Aug 17 19:56:04 user nova-compute[72815]:   </nova:owner>
Aug 17 19:56:04 user nova-compute[72815]:   <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:56:04 user nova-compute[72815]:   <nova:ports>
Aug 17 19:56:04 user nova-compute[72815]:     <nova:port uuid="011707bb-905e-49f1-8517-e58e6907e383">
Aug 17 19:56:04 user nova-compute[72815]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 19:56:04 user nova-compute[72815]:     </nova:port>
Aug 17 19:56:04 user nova-compute[72815]:     <nova:port uuid="1c8db3b8-c66d-4904-b304-7a60777894e2">
Aug 17 19:56:04 user nova-compute[72815]:       <nova:ip type="fixed" address="10.10.10.46" ipVersion="4"/>
Aug 17 19:56:04 user nova-compute[72815]:     </nova:port>
Aug 17 19:56:04 user nova-compute[72815]:   </nova:ports>
Aug 17 19:56:04 user nova-compute[72815]: </nova:instance>
Aug 17 19:56:04 user nova-compute[72815]:  {{(pid=72815) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-04e2a9f8-c3d2-4344-9c4f-9b098332da44 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "interface-07f12446-7bbc-4b95-a79b-99d48fa23d63-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 6.828s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-4f01f5d2-b04b-44bd-b5be-7b3df5ff506f req-48160c96-a3c8-4f1b-8424-6944825c0a9d service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Received event network-changed-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-4f01f5d2-b04b-44bd-b5be-7b3df5ff506f req-48160c96-a3c8-4f1b-8424-6944825c0a9d service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Refreshing instance network info cache due to event network-changed-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4f01f5d2-b04b-44bd-b5be-7b3df5ff506f req-48160c96-a3c8-4f1b-8424-6944825c0a9d service nova] Acquiring lock "refresh_cache-01fdb794-dc6b-412b-95e1-c6c80cb81ecf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4f01f5d2-b04b-44bd-b5be-7b3df5ff506f req-48160c96-a3c8-4f1b-8424-6944825c0a9d service nova] Acquired lock "refresh_cache-01fdb794-dc6b-412b-95e1-c6c80cb81ecf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG nova.network.neutron [req-4f01f5d2-b04b-44bd-b5be-7b3df5ff506f req-48160c96-a3c8-4f1b-8424-6944825c0a9d service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Refreshing network info cache for port a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:05 user nova-compute[72815]: DEBUG nova.network.neutron [req-9cdcedeb-c962-422c-9efa-0781e160dce5 req-2cde7db8-e4f9-48bc-9ac9-c54c7de1826b service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Updated VIF entry in instance network info cache for port 1c8db3b8-c66d-4904-b304-7a60777894e2. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:56:05 user nova-compute[72815]: DEBUG nova.network.neutron [req-9cdcedeb-c962-422c-9efa-0781e160dce5 req-2cde7db8-e4f9-48bc-9ac9-c54c7de1826b service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Updating instance_info_cache with network_info: [{"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9cdcedeb-c962-422c-9efa-0781e160dce5 req-2cde7db8-e4f9-48bc-9ac9-c54c7de1826b service nova] Releasing lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:05 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302150.7232492, 1800ab7b-dd88-45fb-9370-1b77b8cbf893 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:56:05 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] VM Stopped (Lifecycle Event)
Aug 17 19:56:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-77360bfa-db35-441f-93ed-9260ead1d6dd None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-77360bfa-db35-441f-93ed-9260ead1d6dd None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Apgrbuos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:06 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:06 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:06 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0055139c-956b-4f84-8de5-21b9b8e20708]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:56:06 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fcfe19-2054-473b-9e4e-0ff95f306ba6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea] added
Aug 17 19:56:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYlkJcFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:06 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[99706c3f-eeda-42bb-9b89-e32dd51007b9]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e80cee2-a023-4a1d-b82c-592548f9827e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Apgrbuos {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Apgrbuos" returned: 0 in 0.033s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad18c1b-ab7e-462e-9e42-b5045b60fac2]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Apgrbuos'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9380c0-dd0a-4c3a-887c-d10bd3069838]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4894abf9-f960-44dd-9f26-85e5a862d660]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lazy-loading 'flavor' on Instance uuid 01fdb794-dc6b-412b-95e1-c6c80cb81ecf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dfb2e0-96d3-4592-bd60-e5131fddc197]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea, portal: 172.16.0.220,3260]
Aug 17 19:56:06 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lazy-loading 'flavor' on Instance uuid 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9d9b10-1ef4-4ad0-8b49-ff364f131c2d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f78bb17-c9a3-4baa-a5d3-5379d9968bb7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXAzmIeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:06 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:06 user nova-compute[72815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)
Aug 17 19:56:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:06 user nova-compute[72815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)
Aug 17 19:56:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5493558c-a016-42e0-9abc-433b99062dd8]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Apgrbuos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:06 user nova-compute[72815]: INFO nova.compute.manager [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Attaching volume 6999e88d-0317-40b2-aad1-8314e34739a3 to /dev/vdb
Aug 17 19:56:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-15f2e7d6-5972-4f2d-ad47-62add2e5c8bc req-9e180e69-1b06-4c63-a72c-d4ab08ea0c25 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-vif-plugged-1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-15f2e7d6-5972-4f2d-ad47-62add2e5c8bc req-9e180e69-1b06-4c63-a72c-d4ab08ea0c25 service nova] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-15f2e7d6-5972-4f2d-ad47-62add2e5c8bc req-9e180e69-1b06-4c63-a72c-d4ab08ea0c25 service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-15f2e7d6-5972-4f2d-ad47-62add2e5c8bc req-9e180e69-1b06-4c63-a72c-d4ab08ea0c25 service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-15f2e7d6-5972-4f2d-ad47-62add2e5c8bc req-9e180e69-1b06-4c63-a72c-d4ab08ea0c25 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] No waiting events found dispatching network-vif-plugged-1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:06 user nova-compute[72815]: WARNING nova.compute.manager [req-15f2e7d6-5972-4f2d-ad47-62add2e5c8bc req-9e180e69-1b06-4c63-a72c-d4ab08ea0c25 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received unexpected event network-vif-plugged-1c8db3b8-c66d-4904-b304-7a60777894e2 for instance with vm_state active and task_state None.
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:06 user nova-compute[72815]: INFO nova.compute.manager [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Attaching volume b890a7d5-cdad-4ddd-855a-501363a5f064 to /dev/vdb
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.utils [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG nova.network.neutron [req-4f01f5d2-b04b-44bd-b5be-7b3df5ff506f req-48160c96-a3c8-4f1b-8424-6944825c0a9d service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Updated VIF entry in instance network info cache for port a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG nova.network.neutron [req-4f01f5d2-b04b-44bd-b5be-7b3df5ff506f req-48160c96-a3c8-4f1b-8424-6944825c0a9d service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Updating instance_info_cache with network_info: [{"id": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "address": "fa:16:3e:7d:d0:02", "network": {"id": "c99b980b-310e-49e8-8ac8-03448305c844", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1208402457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d2bd59500f4ad39fdb1a3860452b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa57b3e59-1c", "ovs_interfaceid": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a80615-aefd-4797-bc7e-0162beb4a824]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.utils [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4f01f5d2-b04b-44bd-b5be-7b3df5ff506f req-48160c96-a3c8-4f1b-8424-6944825c0a9d service nova] Releasing lock "refresh_cache-01fdb794-dc6b-412b-95e1-c6c80cb81ecf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ccb2b1-a11f-4b52-8a18-0b3002508fd2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[feefc508-09ff-4793-aca3-aea02b47b36e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d432c033-82df-4551-9146-30a90d25306b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[479719f9-7cc0-4ddd-8784-c712a7f92ce0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a784807-876f-4ea7-a137-c7f524b626a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:56:06 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2fde3a-02d2-4e38-b0ca-11609926187d]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[722cfdbb-ac30-4156-ac89-857d70002d79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.utils [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Updating existing volume attachment record: a6d327a1-7a5c-46ca-8c94-3d9e7acc0c6a {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3353095c-ff95-4f08-a7e7-52e1aeeba279]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:56:06 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:56:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[84678a47-f19e-40ce-8476-6d1a549defd3]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG os_brick.utils [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:06 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Updating existing volume attachment record: 2ebe022f-4b3e-41fb-bac1-bfbd1052a0ce {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '26138326464383466', 'path': '/dev/sdc'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138326464383466', 'path': '/dev/sdc'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.319s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:07 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:07 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG nova.objects.instance [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lazy-loading 'flavor' on Instance uuid d00ba879-4c0f-4682-be36-8d61f44af9cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacf265d-41e0-475f-98b5-b2ed367daaaa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:56:07 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:56:07 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:07 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 19:56:07 user nova-compute[72815]:   <target dev="sdc" bus="scsi"/>
Aug 17 19:56:07 user nova-compute[72815]:   <serial>224da194-b3e5-4961-bb70-0d4b091c1eea</serial>
Aug 17 19:56:07 user nova-compute[72815]:   <address type="drive" controller="0" unit="2"/>
Aug 17 19:56:07 user nova-compute[72815]: </disk>
Aug 17 19:56:07 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0403a5bc-080c-4242-b4c9-b3cdfa377c5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250] added
Aug 17 19:56:07 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c09f62-b95c-49fc-84be-c7bd18edd80a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[54850c76-e4f7-4bb1-a156-9ea9ee1924dc]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYlkJcFV {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYlkJcFV" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0611565d-51d4-4957-ad84-a06c663befc5]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KYlkJcFV'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cea0910-974b-4b8e-aaff-3cacbc20db10]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e65fe-e4cf-40b9-80ba-8ac0b3b039a9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:07 user nova-compute[72815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)
Aug 17 19:56:07 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:07 user nova-compute[72815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)
Aug 17 19:56:07 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[972cade8-45cd-4943-95f7-938177b31aca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250, portal: 172.16.0.220,3260]
Aug 17 19:56:07 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:07 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0834459-e4df-432c-a033-91ee1f1adeb2]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[08819d4b-fa7a-4024-95f2-4a687554c0ec]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:07 user nova-compute[72815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)
Aug 17 19:56:07 user nova-compute[72815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)
Aug 17 19:56:07 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:07 user nova-compute[72815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)
Aug 17 19:56:07 user nova-compute[72815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)
Aug 17 19:56:07 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b1f389-3d74-4b06-86ed-2315b3e3a206]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:56:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYlkJcFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] No BDM found with device name sda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] No VIF found with MAC fa:16:3e:c1:d6:5f, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47e671dc-223e-430b-ba1b-84650b529c30 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.583s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-d80f3155-41aa-48fa-9506-6b10443e124e req-d3eb1880-2b11-43e4-b411-ac303cc2bbfe service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-vif-plugged-1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d80f3155-41aa-48fa-9506-6b10443e124e req-d3eb1880-2b11-43e4-b411-ac303cc2bbfe service nova] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d80f3155-41aa-48fa-9506-6b10443e124e req-d3eb1880-2b11-43e4-b411-ac303cc2bbfe service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d80f3155-41aa-48fa-9506-6b10443e124e req-d3eb1880-2b11-43e4-b411-ac303cc2bbfe service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-d80f3155-41aa-48fa-9506-6b10443e124e req-d3eb1880-2b11-43e4-b411-ac303cc2bbfe service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] No waiting events found dispatching network-vif-plugged-1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:08 user nova-compute[72815]: WARNING nova.compute.manager [req-d80f3155-41aa-48fa-9506-6b10443e124e req-d3eb1880-2b11-43e4-b411-ac303cc2bbfe service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received unexpected event network-vif-plugged-1c8db3b8-c66d-4904-b304-7a60777894e2 for instance with vm_state active and task_state None.
Aug 17 19:56:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "45b6365f-333f-45f1-b619-3453cbe75a88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "45b6365f-333f-45f1-b619-3453cbe75a88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG nova.compute.manager [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] <== connect_volume: return (2656ms) {'type': 'block', 'scsi_wwn': '23661303764663862', 'path': '/dev/sdd'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661303764663862', 'path': '/dev/sdd'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.398s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:08 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:08 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:08 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:56:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG nova.objects.instance [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lazy-loading 'flavor' on Instance uuid 969a1301-2014-4b22-8074-a0ac35136249 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a670822-4a9c-497d-be75-9dfb28b95e45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:56:08 user nova-compute[72815]: INFO nova.compute.claims [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Claim successful on node user
Aug 17 19:56:08 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:56:08 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:56:08 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:08 user nova-compute[72815]:   <source dev="/dev/sdd"/>
Aug 17 19:56:08 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:56:08 user nova-compute[72815]:   <serial>25520b69-5198-4f5a-8f55-73e72976b250</serial>
Aug 17 19:56:08 user nova-compute[72815]: </disk>
Aug 17 19:56:08 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:56:08 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[87414f87-a9be-4c92-bf11-1bc709247a1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb] added
Aug 17 19:56:09 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49f654f-e2c5-46fa-9c2c-9410a549bd86]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd703890-8ca8-43fe-a606-b162f809c44e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CXAzmIeb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CXAzmIeb" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb012f5-ab41-47ff-b982-793c76502114]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CXAzmIeb'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76d688e-925b-4fc2-925d-7d8c28da1574]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb11fe8-f7fe-442e-8bb8-1c03b58083b5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:09 user nova-compute[72815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)
Aug 17 19:56:09 user nova-compute[72815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)
Aug 17 19:56:09 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:09 user nova-compute[72815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)
Aug 17 19:56:09 user nova-compute[72815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)
Aug 17 19:56:09 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[10013841-09d5-4a27-8494-aaa1c0b2371d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb, portal: 172.16.0.220,3260]
Aug 17 19:56:09 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:09 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:09 user nova-compute[72815]: INFO nova.compute.manager [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Detaching volume 224da194-b3e5-4961-bb70-0d4b091c1eea
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22afd0f-7d83-4576-9be9-9a2c009a5e06]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5afa06d-762c-47a1-ac00-590855690405]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:09 user nova-compute[72815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)
Aug 17 19:56:09 user nova-compute[72815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)
Aug 17 19:56:09 user nova-compute[72815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb (non-flash)
Aug 17 19:56:09 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:09 user nova-compute[72815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)
Aug 17 19:56:09 user nova-compute[72815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)
Aug 17 19:56:09 user nova-compute[72815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb (non-flash)
Aug 17 19:56:09 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.869s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:09 user nova-compute[72815]: INFO nova.virt.block_device [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Attempting to driver detach volume 224da194-b3e5-4961-bb70-0d4b091c1eea from mountpoint /dev/sdc
Aug 17 19:56:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] No VIF found with MAC fa:16:3e:e1:b7:04, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f499d7-726b-473d-86e9-437dee54bf75]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXAzmIeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Attempting to detach device sdc from instance d00ba879-4c0f-4682-be36-8d61f44af9cf from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:56:09 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:09 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 19:56:09 user nova-compute[72815]:   <target dev="sdc" bus="scsi"/>
Aug 17 19:56:09 user nova-compute[72815]:   <serial>224da194-b3e5-4961-bb70-0d4b091c1eea</serial>
Aug 17 19:56:09 user nova-compute[72815]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 19:56:09 user nova-compute[72815]: </disk>
Aug 17 19:56:09 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:56:09 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Successfully detached device sdc from instance d00ba879-4c0f-4682-be36-8d61f44af9cf from the persistent domain config.
Aug 17 19:56:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance d00ba879-4c0f-4682-be36-8d61f44af9cf from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 19:56:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:56:09 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:09 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 19:56:09 user nova-compute[72815]:   <target dev="sdc" bus="scsi"/>
Aug 17 19:56:09 user nova-compute[72815]:   <serial>224da194-b3e5-4961-bb70-0d4b091c1eea</serial>
Aug 17 19:56:09 user nova-compute[72815]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 19:56:09 user nova-compute[72815]: </disk>
Aug 17 19:56:09 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39df844a-4f2f-40a4-ad83-feb7e3d36fb0 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "969a1301-2014-4b22-8074-a0ac35136249" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.309s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.188s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.network.neutron [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:56:10 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302170.3874648, d00ba879-4c0f-4682-be36-8d61f44af9cf => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance d00ba879-4c0f-4682-be36-8d61f44af9cf {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 19:56:10 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Successfully detached device sdc from instance d00ba879-4c0f-4682-be36-8d61f44af9cf from the live domain config.
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Apgrbuos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:10 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.policy [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '190c2e4fdf3e49c3a760e332ab09baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddf9ff8534e4c1c8afc48c9d02fefcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:56:10 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Creating image(s)
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "/opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "/opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "/opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.215s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.013s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.928s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] <== connect_volume: return (4328ms) {'type': 'block', 'scsi_wwn': '23934373261316663', 'path': '/dev/sde'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934373261316663', 'path': '/dev/sde'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.462s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.objects.instance [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lazy-loading 'flavor' on Instance uuid e4a8f42b-da98-4652-be1f-393b790a87f1 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2741f9c-96d3-4bcb-8810-3227fb3e845f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a06bb14-e668-49e5-930a-62fbbf8f8bfd]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:10 user nova-compute[72815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)
Aug 17 19:56:10 user nova-compute[72815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)
Aug 17 19:56:10 user nova-compute[72815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb (non-flash)
Aug 17 19:56:10 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:10 user nova-compute[72815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea (non-flash)
Aug 17 19:56:10 user nova-compute[72815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)
Aug 17 19:56:10 user nova-compute[72815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb (non-flash)
Aug 17 19:56:10 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b43c1750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea'): ({'sdc'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Removing single pathed devices sdc {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] attach device xml: <disk type="block" device="disk">
Aug 17 19:56:10 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:10 user nova-compute[72815]:   <source dev="/dev/sde"/>
Aug 17 19:56:10 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:56:10 user nova-compute[72815]:   <serial>2b4d17c3-df66-490e-bc27-7e04b83559bb</serial>
Aug 17 19:56:10 user nova-compute[72815]: </disk>
Aug 17 19:56:10 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[798aad37-3fa5-4e5c-99e0-0c8917695d41]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk 1073741824" returned: 0 in 0.050s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c876fb9-017b-4372-a2d1-9fbbd36e182f]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Flushing IO for device /dev/sdc {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[82151d85-b553-4841-96c3-56ab95842818]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ed398b-8bd8-41cb-afdd-6f266f6206ec]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3cd22f-cd14-43c8-b0cd-4b4c6d5827c8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afd4d6a-6862-4255-8316-39a73c2765fa]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea, portal: 172.16.0.220,3260]
Aug 17 19:56:11 user nova-compute[72815]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:11 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224da194-b3e5-4961-bb70-0d4b091c1eea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c7981a-9a5f-4f4b-8a6d-f9609095b00b]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] <== disconnect_volume: return (908ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG nova.network.neutron [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Successfully created port: 14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Cannot resize image /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG nova.objects.instance [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lazy-loading 'migration_context' on Instance uuid 45b6365f-333f-45f1-b619-3453cbe75a88 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Ensure instance console log exists: /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] No VIF found with MAC fa:16:3e:60:5d:1b, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Successfully updated port: 14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquired lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-12ae6425-b2d4-40f9-82b6-848b977514e9 req-60b6f359-15ea-467c-85af-dc135add01a2 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Received event network-changed-14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-12ae6425-b2d4-40f9-82b6-848b977514e9 req-60b6f359-15ea-467c-85af-dc135add01a2 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Refreshing instance network info cache due to event network-changed-14230629-a60c-41b1-a7ba-bed70d03d123. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-12ae6425-b2d4-40f9-82b6-848b977514e9 req-60b6f359-15ea-467c-85af-dc135add01a2 service nova] Acquiring lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lazy-loading 'flavor' on Instance uuid d00ba879-4c0f-4682-be36-8d61f44af9cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3c88c86a-29b8-466a-89b2-027ad4e4dc57 tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.174s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09d85589-607d-4869-a185-df969ac03b75 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.805s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Updating instance_info_cache with network_info: [{"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Releasing lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Instance network_info: |[{"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-12ae6425-b2d4-40f9-82b6-848b977514e9 req-60b6f359-15ea-467c-85af-dc135add01a2 service nova] Acquired lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.network.neutron [req-12ae6425-b2d4-40f9-82b6-848b977514e9 req-60b6f359-15ea-467c-85af-dc135add01a2 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Refreshing network info cache for port 14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Start _get_guest_xml network_info=[{"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:56:12 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:56:12 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1845893949',display_name='tempest-TestStampPattern-server-1845893949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1845893949',id=11,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqC6RUkKN1taHh2Rn8c1allkbJ0/yuwdo3QXAdudNtPlH8PHi5tBUQIsWAsylFF7ZKs0Ps3Kru7ooqRhdzKKP021tMxib7YsWN4dc0onmkUhJNvpAEEo06cjY/saqY+9Q==',key_name='tempest-TestStampPattern-190535839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dddf9ff8534e4c1c8afc48c9d02fefcb',ramdisk_id='',reservation_id='r-l0nuu05l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1204244634',owner_user_name='tempest-TestStampPattern-1204244634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:56:10Z,user_data=None,user_id='190c2e4fdf3e49c3a760e332ab09baf3',uuid=45b6365f-333f-45f1-b619-3453cbe75a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Converting VIF {"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=14230629-a60c-41b1-a7ba-bed70d03d123,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14230629-a6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lazy-loading 'pci_devices' on Instance uuid 45b6365f-333f-45f1-b619-3453cbe75a88 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:56:12 user nova-compute[72815]:   <uuid>45b6365f-333f-45f1-b619-3453cbe75a88</uuid>
Aug 17 19:56:12 user nova-compute[72815]:   <name>instance-0000000b</name>
Aug 17 19:56:12 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:56:12 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:56:12 user nova-compute[72815]:   <metadata>
Aug 17 19:56:12 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:56:12 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:56:12 user nova-compute[72815]:       <nova:name>tempest-TestStampPattern-server-1845893949</nova:name>
Aug 17 19:56:12 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:56:12</nova:creationTime>
Aug 17 19:56:12 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:56:12 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:56:12 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:56:12 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:56:12 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:56:12 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:56:12 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:56:12 user nova-compute[72815]:       <nova:owner>
Aug 17 19:56:12 user nova-compute[72815]:         <nova:user uuid="190c2e4fdf3e49c3a760e332ab09baf3">tempest-TestStampPattern-1204244634-project-member</nova:user>
Aug 17 19:56:12 user nova-compute[72815]:         <nova:project uuid="dddf9ff8534e4c1c8afc48c9d02fefcb">tempest-TestStampPattern-1204244634</nova:project>
Aug 17 19:56:12 user nova-compute[72815]:       </nova:owner>
Aug 17 19:56:12 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:56:12 user nova-compute[72815]:       <nova:ports>
Aug 17 19:56:12 user nova-compute[72815]:         <nova:port uuid="14230629-a60c-41b1-a7ba-bed70d03d123">
Aug 17 19:56:12 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 19:56:12 user nova-compute[72815]:         </nova:port>
Aug 17 19:56:12 user nova-compute[72815]:       </nova:ports>
Aug 17 19:56:12 user nova-compute[72815]:     </nova:instance>
Aug 17 19:56:12 user nova-compute[72815]:   </metadata>
Aug 17 19:56:12 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:56:12 user nova-compute[72815]:     <system>
Aug 17 19:56:12 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:56:12 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:56:12 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:56:12 user nova-compute[72815]:       <entry name="serial">45b6365f-333f-45f1-b619-3453cbe75a88</entry>
Aug 17 19:56:12 user nova-compute[72815]:       <entry name="uuid">45b6365f-333f-45f1-b619-3453cbe75a88</entry>
Aug 17 19:56:12 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:56:12 user nova-compute[72815]:     </system>
Aug 17 19:56:12 user nova-compute[72815]:   </sysinfo>
Aug 17 19:56:12 user nova-compute[72815]:   <os>
Aug 17 19:56:12 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:56:12 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:56:12 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:56:12 user nova-compute[72815]:   </os>
Aug 17 19:56:12 user nova-compute[72815]:   <features>
Aug 17 19:56:12 user nova-compute[72815]:     <acpi/>
Aug 17 19:56:12 user nova-compute[72815]:     <apic/>
Aug 17 19:56:12 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:56:12 user nova-compute[72815]:   </features>
Aug 17 19:56:12 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:56:12 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:56:12 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:56:12 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:56:12 user nova-compute[72815]:   </clock>
Aug 17 19:56:12 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:56:12 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:56:12 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:56:12 user nova-compute[72815]:   </cpu>
Aug 17 19:56:12 user nova-compute[72815]:   <devices>
Aug 17 19:56:12 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:56:12 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:56:12 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk"/>
Aug 17 19:56:12 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:56:12 user nova-compute[72815]:     </disk>
Aug 17 19:56:12 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:56:12 user nova-compute[72815]:       <mac address="fa:16:3e:63:03:8c"/>
Aug 17 19:56:12 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:56:12 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:56:12 user nova-compute[72815]:       <target dev="tap14230629-a6"/>
Aug 17 19:56:12 user nova-compute[72815]:     </interface>
Aug 17 19:56:12 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:56:12 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/console.log" append="off"/>
Aug 17 19:56:12 user nova-compute[72815]:     </serial>
Aug 17 19:56:12 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:56:12 user nova-compute[72815]:     <video>
Aug 17 19:56:12 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:56:12 user nova-compute[72815]:     </video>
Aug 17 19:56:12 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:56:12 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:56:12 user nova-compute[72815]:     </rng>
Aug 17 19:56:12 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:56:12 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:56:12 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:56:12 user nova-compute[72815]:     </memballoon>
Aug 17 19:56:12 user nova-compute[72815]:   </devices>
Aug 17 19:56:12 user nova-compute[72815]: </domain>
Aug 17 19:56:12 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1845893949',display_name='tempest-TestStampPattern-server-1845893949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1845893949',id=11,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqC6RUkKN1taHh2Rn8c1allkbJ0/yuwdo3QXAdudNtPlH8PHi5tBUQIsWAsylFF7ZKs0Ps3Kru7ooqRhdzKKP021tMxib7YsWN4dc0onmkUhJNvpAEEo06cjY/saqY+9Q==',key_name='tempest-TestStampPattern-190535839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dddf9ff8534e4c1c8afc48c9d02fefcb',ramdisk_id='',reservation_id='r-l0nuu05l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1204244634',owner_user_name='tempest-TestStampPattern-1204244634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:56:10Z,user_data=None,user_id='190c2e4fdf3e49c3a760e332ab09baf3',uuid=45b6365f-333f-45f1-b619-3453cbe75a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Converting VIF {"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=14230629-a60c-41b1-a7ba-bed70d03d123,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14230629-a6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG os_vif [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=14230629-a60c-41b1-a7ba-bed70d03d123,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14230629-a6') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6809e3e1-f1a2-41ab-b968-5962ade36b50 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] volume_snapshot_create: create_info: {'snapshot_id': 'f20f0be2-4bda-4857-b29a-07924a5d2aa5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72815) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14230629-a6, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14230629-a6, col_values=(('external_ids', {'iface-id': '14230629-a60c-41b1-a7ba-bed70d03d123', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:03:8c', 'vm-uuid': '45b6365f-333f-45f1-b619-3453cbe75a88'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6809e3e1-f1a2-41ab-b968-5962ade36b50 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] snap xml: <domainsnapshot>
Aug 17 19:56:12 user nova-compute[72815]:   <disks>
Aug 17 19:56:12 user nova-compute[72815]:     <disk name="/dev/sde" snapshot="external" type="file">
Aug 17 19:56:12 user nova-compute[72815]:       <source file="/dev/new_file"/>
Aug 17 19:56:12 user nova-compute[72815]:     </disk>
Aug 17 19:56:12 user nova-compute[72815]:     <disk name="vda" snapshot="no"/>
Aug 17 19:56:12 user nova-compute[72815]:   </disks>
Aug 17 19:56:12 user nova-compute[72815]: </domainsnapshot>
Aug 17 19:56:12 user nova-compute[72815]:  {{(pid=72815) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6809e3e1-f1a2-41ab-b968-5962ade36b50 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lazy-loading 'system_metadata' on Instance uuid e4a8f42b-da98-4652-be1f-393b790a87f1 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:12 user nova-compute[72815]: INFO os_vif [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=14230629-a60c-41b1-a7ba-bed70d03d123,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14230629-a6')
Aug 17 19:56:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6809e3e1-f1a2-41ab-b968-5962ade36b50 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [None req-6809e3e1-f1a2-41ab-b968-5962ade36b50 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Traceback (most recent call last):
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     rv = execute(f, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     six.reraise(c, e, tb)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     raise value
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     rv = meth(*args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] 
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [None req-6809e3e1-f1a2-41ab-b968-5962ade36b50 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Traceback (most recent call last):
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     self._volume_snapshot_create(context, instance, guest,
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     rv = execute(f, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     six.reraise(c, e, tb)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     raise value
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     rv = meth(*args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] 
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a2fe0860-8765-4383-bffa-e8e75a53afaa tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] volume_snapshot_delete: delete_info: {'volume_id': '2b4d17c3-df66-490e-bc27-7e04b83559bb'} {{(pid=72815) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [None req-a2fe0860-8765-4383-bffa-e8e75a53afaa tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Traceback (most recent call last):
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1]     if delete_info['type'] != 'qcow2':
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] KeyError: 'type'
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] 
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] No VIF found with MAC fa:16:3e:63:03:8c, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:13 user nova-compute[72815]: INFO nova.compute.manager [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Terminating instance
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [None req-6809e3e1-f1a2-41ab-b968-5962ade36b50 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot f20f0be2-4bda-4857-b29a-07924a5d2aa5 could not be found.
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     raise value
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver 
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver 
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot f20f0be2-4bda-4857-b29a-07924a5d2aa5 could not be found. (HTTP 404) (Request-ID: req-4a730e5a-9d1a-4fa3-bf21-e20e173c0a96)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver 
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver 
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot f20f0be2-4bda-4857-b29a-07924a5d2aa5 could not be found.
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver 
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server [None req-6809e3e1-f1a2-41ab-b968-5962ade36b50 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     raise value
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server 
Aug 17 19:56:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver [None req-a2fe0860-8765-4383-bffa-e8e75a53afaa tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver 
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver 
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-ab64fa56-6a61-4bae-a5a8-6c8fccf67cc5)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver 
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver 
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 19:56:13 user nova-compute[72815]: ERROR nova.virt.libvirt.driver 
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server [None req-a2fe0860-8765-4383-bffa-e8e75a53afaa tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Exception during message handling: KeyError: 'type'
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 17 19:56:13 user nova-compute[72815]: ERROR oslo_messaging.rpc.server 
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "969a1301-2014-4b22-8074-a0ac35136249" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "969a1301-2014-4b22-8074-a0ac35136249" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:13 user nova-compute[72815]: INFO nova.compute.manager [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Detaching volume 25520b69-5198-4f5a-8f55-73e72976b250
Aug 17 19:56:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:13 user nova-compute[72815]: INFO nova.virt.block_device [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Attempting to driver detach volume 25520b69-5198-4f5a-8f55-73e72976b250 from mountpoint /dev/vdb
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-a6d0f47f-1ee9-4b5a-98b1-bee9b3e301ed req-ea50b89f-5a0e-4104-bf96-afd840bfd061 service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Received event network-vif-unplugged-8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a6d0f47f-1ee9-4b5a-98b1-bee9b3e301ed req-ea50b89f-5a0e-4104-bf96-afd840bfd061 service nova] Acquiring lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a6d0f47f-1ee9-4b5a-98b1-bee9b3e301ed req-ea50b89f-5a0e-4104-bf96-afd840bfd061 service nova] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a6d0f47f-1ee9-4b5a-98b1-bee9b3e301ed req-ea50b89f-5a0e-4104-bf96-afd840bfd061 service nova] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-a6d0f47f-1ee9-4b5a-98b1-bee9b3e301ed req-ea50b89f-5a0e-4104-bf96-afd840bfd061 service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] No waiting events found dispatching network-vif-unplugged-8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-a6d0f47f-1ee9-4b5a-98b1-bee9b3e301ed req-ea50b89f-5a0e-4104-bf96-afd840bfd061 service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Received event network-vif-unplugged-8fe39d89-b180-4d36-aa58-5956cc68e1b9 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Attempting to detach device vdb from instance 969a1301-2014-4b22-8074-a0ac35136249 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:56:13 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:13 user nova-compute[72815]:   <source dev="/dev/sdd"/>
Aug 17 19:56:13 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:56:13 user nova-compute[72815]:   <serial>25520b69-5198-4f5a-8f55-73e72976b250</serial>
Aug 17 19:56:13 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:56:13 user nova-compute[72815]: </disk>
Aug 17 19:56:13 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:56:13 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Successfully detached device vdb from instance 969a1301-2014-4b22-8074-a0ac35136249 from the persistent domain config.
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 969a1301-2014-4b22-8074-a0ac35136249 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:56:13 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:13 user nova-compute[72815]:   <source dev="/dev/sdd"/>
Aug 17 19:56:13 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:56:13 user nova-compute[72815]:   <serial>25520b69-5198-4f5a-8f55-73e72976b250</serial>
Aug 17 19:56:13 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:56:13 user nova-compute[72815]: </disk>
Aug 17 19:56:13 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Acquiring lock "e4a8f42b-da98-4652-be1f-393b790a87f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:13 user nova-compute[72815]: INFO nova.compute.manager [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Detaching volume 2b4d17c3-df66-490e-bc27-7e04b83559bb
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-12ae6425-b2d4-40f9-82b6-848b977514e9 req-60b6f359-15ea-467c-85af-dc135add01a2 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Updated VIF entry in instance network info cache for port 14230629-a60c-41b1-a7ba-bed70d03d123. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-12ae6425-b2d4-40f9-82b6-848b977514e9 req-60b6f359-15ea-467c-85af-dc135add01a2 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Updating instance_info_cache with network_info: [{"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-12ae6425-b2d4-40f9-82b6-848b977514e9 req-60b6f359-15ea-467c-85af-dc135add01a2 service nova] Releasing lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:13 user nova-compute[72815]: INFO nova.virt.block_device [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Attempting to driver detach volume 2b4d17c3-df66-490e-bc27-7e04b83559bb from mountpoint /dev/vdb
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Attempting to detach device vdb from instance e4a8f42b-da98-4652-be1f-393b790a87f1 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 19:56:13 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:13 user nova-compute[72815]:   <source dev="/dev/sde"/>
Aug 17 19:56:13 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:56:13 user nova-compute[72815]:   <serial>2b4d17c3-df66-490e-bc27-7e04b83559bb</serial>
Aug 17 19:56:13 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:56:13 user nova-compute[72815]: </disk>
Aug 17 19:56:13 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:56:13 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Successfully detached device vdb from instance e4a8f42b-da98-4652-be1f-393b790a87f1 from the persistent domain config.
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4a8f42b-da98-4652-be1f-393b790a87f1 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 19:56:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 19:56:13 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:13 user nova-compute[72815]:   <source dev="/dev/sde"/>
Aug 17 19:56:13 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:56:13 user nova-compute[72815]:   <serial>2b4d17c3-df66-490e-bc27-7e04b83559bb</serial>
Aug 17 19:56:13 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:56:13 user nova-compute[72815]: </disk>
Aug 17 19:56:13 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302174.0464997, 969a1301-2014-4b22-8074-a0ac35136249 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 969a1301-2014-4b22-8074-a0ac35136249 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 19:56:14 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Successfully detached device vdb from instance 969a1301-2014-4b22-8074-a0ac35136249 from the live domain config.
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYlkJcFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:14 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe417e0-dc10-45c4-b13c-739a8a16a539]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2682e6ec-415d-41ce-992d-7e1e342951f4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:14 user nova-compute[72815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)
Aug 17 19:56:14 user nova-compute[72815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb (non-flash)
Aug 17 19:56:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:14 user nova-compute[72815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 (non-flash)
Aug 17 19:56:14 user nova-compute[72815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb (non-flash)
Aug 17 19:56:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39947439a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250'): ({'sdd'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Removing single pathed devices sdd {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77aeda2-e84a-45a4-951e-ea25bfab183b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[78809274-1ad9-47b2-b749-8c5155ab65dd]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Flushing IO for device /dev/sdd {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c7c35c-e8cc-4fb7-8e42-6377850c1524]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a4a339-34fb-43fb-98bd-abe287694883]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20808136-dfc8-47af-9130-e5241b5148fc]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5cf4ac-f937-4cd2-9c5a-6c275d1e203d]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250, portal: 172.16.0.220,3260]
Aug 17 19:56:14 user nova-compute[72815]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25520b69-5198-4f5a-8f55-73e72976b250 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1028f60-f890-4c04-82ec-7cd925a9a59f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] <== disconnect_volume: return (300ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302174.6357834, e4a8f42b-da98-4652-be1f-393b790a87f1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4a8f42b-da98-4652-be1f-393b790a87f1 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 19:56:14 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Successfully detached device vdb from instance e4a8f42b-da98-4652-be1f-393b790a87f1 from the live domain config.
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXAzmIeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:14 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Instance destroyed successfully.
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.objects.instance [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lazy-loading 'resources' on Instance uuid d00ba879-4c0f-4682-be36-8d61f44af9cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[80560825-bcdd-46ed-9b2b-d570ed8df1d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-75433482',display_name='tempest-AttachSCSIVolumeTestJSON-server-75433482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-75433482',id=6,image_ref='c98c415f-ad19-49d8-8259-02102cc59bbd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUSj3xmeHrpLu4AWVL10sVmg3+CLvfChvkRscrZ/9Lm72146qtY7SXiXc7/Y0Bc8C2Cc9skB3T0uPNGbwEMNdH+tgdNCC5zYiR8Tfy4MnFgkqkUPYt1aIdwwf/AMiamfA==',key_name='tempest-keypair-201462846',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:54:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cab7108e8ee94ce5be59f7860980d489',ramdisk_id='',reservation_id='r-vahtl3bb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c98c415f-ad19-49d8-8259-02102cc59bbd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1819262802',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1819262802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:54:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4018e49279c1410abc1630cf519c4817',uuid=d00ba879-4c0f-4682-be36-8d61f44af9cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "address": "fa:16:3e:c1:d6:5f", "network": {"id": "cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1059060149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cab7108e8ee94ce5be59f7860980d489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe39d89-b1", "ovs_interfaceid": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Converting VIF {"id": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "address": "fa:16:3e:c1:d6:5f", "network": {"id": "cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1059060149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cab7108e8ee94ce5be59f7860980d489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe39d89-b1", "ovs_interfaceid": "8fe39d89-b180-4d36-aa58-5956cc68e1b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:d6:5f,bridge_name='br-int',has_traffic_filtering=True,id=8fe39d89-b180-4d36-aa58-5956cc68e1b9,network=Network(cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe39d89-b1') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_vif [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:d6:5f,bridge_name='br-int',has_traffic_filtering=True,id=8fe39d89-b180-4d36-aa58-5956cc68e1b9,network=Network(cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe39d89-b1') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fe39d89-b1, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d2fd9d-45b3-47f7-b20b-7e6e5c914790]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:14 user nova-compute[72815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb (non-flash)
Aug 17 19:56:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:14 user nova-compute[72815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb (non-flash)
Aug 17 19:56:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994743e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb'): ({'sde'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Removing single pathed devices sde {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: INFO os_vif [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:d6:5f,bridge_name='br-int',has_traffic_filtering=True,id=8fe39d89-b180-4d36-aa58-5956cc68e1b9,network=Network(cae32ee2-80a9-48e8-8d4f-64a79f4bb1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe39d89-b1')
Aug 17 19:56:14 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Deleting instance files /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf_del
Aug 17 19:56:14 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Deletion of /opt/stack/data/nova/instances/d00ba879-4c0f-4682-be36-8d61f44af9cf_del complete
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ede1d9-e7f4-4561-993e-18d13db8e173]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a3c5b-f4df-419e-82bb-1372fd49251e]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Flushing IO for device /dev/sde {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1f9566-cd5e-41bd-9438-72234b70d891]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: INFO nova.compute.manager [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Took 1.75 seconds to destroy the instance on the hypervisor.
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0905ff0-f4c4-4e9c-a86b-f5f6b3964af6]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcede809-f3cc-467d-9a0f-c0fe3ca05869]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f43065-eec4-432e-83c7-66e2aae138fb]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb, portal: 172.16.0.220,3260]
Aug 17 19:56:14 user nova-compute[72815]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d17c3-df66-490e-bc27-7e04b83559bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d650ef-88cf-4de6-9cf1-fc9d33c71d44]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] <== disconnect_volume: return (309ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:56:15 user nova-compute[72815]: DEBUG nova.objects.instance [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lazy-loading 'flavor' on Instance uuid 969a1301-2014-4b22-8074-a0ac35136249 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e32a0ba3-1435-4e61-926e-5c387a511a7a tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "969a1301-2014-4b22-8074-a0ac35136249" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.091s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-71ac6d46-7b94-4b2a-9d61-86db4d956837 req-3a48d62b-54d6-4c06-8d21-3186105e9a80 service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Received event network-vif-plugged-8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-71ac6d46-7b94-4b2a-9d61-86db4d956837 req-3a48d62b-54d6-4c06-8d21-3186105e9a80 service nova] Acquiring lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-71ac6d46-7b94-4b2a-9d61-86db4d956837 req-3a48d62b-54d6-4c06-8d21-3186105e9a80 service nova] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-71ac6d46-7b94-4b2a-9d61-86db4d956837 req-3a48d62b-54d6-4c06-8d21-3186105e9a80 service nova] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-71ac6d46-7b94-4b2a-9d61-86db4d956837 req-3a48d62b-54d6-4c06-8d21-3186105e9a80 service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] No waiting events found dispatching network-vif-plugged-8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:15 user nova-compute[72815]: WARNING nova.compute.manager [req-71ac6d46-7b94-4b2a-9d61-86db4d956837 req-3a48d62b-54d6-4c06-8d21-3186105e9a80 service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Received unexpected event network-vif-plugged-8fe39d89-b180-4d36-aa58-5956cc68e1b9 for instance with vm_state active and task_state deleting.
Aug 17 19:56:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:16 user nova-compute[72815]: DEBUG nova.objects.instance [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lazy-loading 'flavor' on Instance uuid e4a8f42b-da98-4652-be1f-393b790a87f1 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-424ee444-6502-4bd6-8549-32cbceb87b43 tempest-VolumesAssistedSnapshotsTest-158511064 tempest-VolumesAssistedSnapshotsTest-158511064-project-admin] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.940s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-e86488b9-80d6-4a23-bd68-772de0ca9c7c req-6b77c287-2499-4c30-ad56-929324d1e6a6 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Received event network-vif-plugged-14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e86488b9-80d6-4a23-bd68-772de0ca9c7c req-6b77c287-2499-4c30-ad56-929324d1e6a6 service nova] Acquiring lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e86488b9-80d6-4a23-bd68-772de0ca9c7c req-6b77c287-2499-4c30-ad56-929324d1e6a6 service nova] Lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e86488b9-80d6-4a23-bd68-772de0ca9c7c req-6b77c287-2499-4c30-ad56-929324d1e6a6 service nova] Lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-e86488b9-80d6-4a23-bd68-772de0ca9c7c req-6b77c287-2499-4c30-ad56-929324d1e6a6 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] No waiting events found dispatching network-vif-plugged-14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:16 user nova-compute[72815]: WARNING nova.compute.manager [req-e86488b9-80d6-4a23-bd68-772de0ca9c7c req-6b77c287-2499-4c30-ad56-929324d1e6a6 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Received unexpected event network-vif-plugged-14230629-a60c-41b1-a7ba-bed70d03d123 for instance with vm_state building and task_state spawning.
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:17 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Took 2.68 seconds to deallocate network for instance.
Aug 17 19:56:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302177.6501145, 45b6365f-333f-45f1-b619-3453cbe75a88 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:56:17 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] VM Resumed (Lifecycle Event)
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:56:17 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Instance spawned successfully.
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:17 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302177.6551437, 45b6365f-333f-45f1-b619-3453cbe75a88 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:56:17 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] VM Started (Lifecycle Event)
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:56:17 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:56:17 user nova-compute[72815]: INFO nova.compute.manager [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Took 7.21 seconds to spawn the instance on the hypervisor.
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:17 user nova-compute[72815]: INFO nova.compute.manager [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Took 8.95 seconds to build instance.
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-66824c1e-ba6e-4688-90a1-ca141f64652b tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "45b6365f-333f-45f1-b619-3453cbe75a88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.049s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:56:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:18 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Deleted allocations for instance d00ba879-4c0f-4682-be36-8d61f44af9cf
Aug 17 19:56:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-73f6096c-9183-4cd3-97b5-c9f2fe762f5f tempest-AttachSCSIVolumeTestJSON-1819262802 tempest-AttachSCSIVolumeTestJSON-1819262802-project-member] Lock "d00ba879-4c0f-4682-be36-8d61f44af9cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.148s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-9620ef76-3b66-4092-88d6-6f0a46a5d575 req-bb17415e-4914-4db3-bf92-7e1277397922 service nova] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Received event network-vif-deleted-8fe39d89-b180-4d36-aa58-5956cc68e1b9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-9620ef76-3b66-4092-88d6-6f0a46a5d575 req-bb17415e-4914-4db3-bf92-7e1277397922 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Received event network-vif-plugged-14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9620ef76-3b66-4092-88d6-6f0a46a5d575 req-bb17415e-4914-4db3-bf92-7e1277397922 service nova] Acquiring lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9620ef76-3b66-4092-88d6-6f0a46a5d575 req-bb17415e-4914-4db3-bf92-7e1277397922 service nova] Lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9620ef76-3b66-4092-88d6-6f0a46a5d575 req-bb17415e-4914-4db3-bf92-7e1277397922 service nova] Lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-9620ef76-3b66-4092-88d6-6f0a46a5d575 req-bb17415e-4914-4db3-bf92-7e1277397922 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] No waiting events found dispatching network-vif-plugged-14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:18 user nova-compute[72815]: WARNING nova.compute.manager [req-9620ef76-3b66-4092-88d6-6f0a46a5d575 req-bb17415e-4914-4db3-bf92-7e1277397922 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Received unexpected event network-vif-plugged-14230629-a60c-41b1-a7ba-bed70d03d123 for instance with vm_state active and task_state None.
Aug 17 19:56:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JawgxXCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:19 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:19 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:19 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dccbcd-e66c-4b61-8a62-40ab0575236b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:56:19 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cad2484-2629-4eb7-b774-0c9c1788e39f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3] added
Aug 17 19:56:19 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea3b141-5f10-4277-9058-c8be2d770534]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7f1907-6a89-4bcf-9e7c-bd4f79427ce8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JawgxXCq {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JawgxXCq" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f1f975-b372-43f7-a1b2-63dade502cbd]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JawgxXCq'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace45275-38e1-4751-b920-ce703efc8936]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff1f0d7-dd0b-47bf-ab43-9363b3e0a737]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:19 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:19 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e3e93d-dd43-427c-b350-9468e213b450]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260]
Aug 17 19:56:19 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:19 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bfa198-470b-4822-9234-563564f7780e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b97a2bf-7638-49b8-8bfb-0e89392ee526]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:19 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:19 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:19 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:19 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[064ed4ee-f48a-47f5-8492-2ab2dd6c0255]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JawgxXCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLhXSZsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:19 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23166636263656263', 'path': '/dev/sdc'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166636263656263', 'path': '/dev/sdc'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.825s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:20 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:20 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lazy-loading 'flavor' on Instance uuid 01fdb794-dc6b-412b-95e1-c6c80cb81ecf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a838c282-237b-4ce1-9ea0-ec1e1d59fc89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:56:20 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:56:20 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:20 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 19:56:20 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:56:20 user nova-compute[72815]:   <serial>6999e88d-0317-40b2-aad1-8314e34739a3</serial>
Aug 17 19:56:20 user nova-compute[72815]: </disk>
Aug 17 19:56:20 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[795872fe-9479-48f6-b68b-567d7c6e7038]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064] added
Aug 17 19:56:20 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1019c1b1-1f61-4cf1-b7d2-677837aac2d8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9df1ab8-0058-40b7-a967-e14d51490b44]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLhXSZsT {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLhXSZsT" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[250f014b-86b8-4aca-bda1-20ed01fef676]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pLhXSZsT'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df9b77f-a8a5-4f5a-9fde-1a99c309a495]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62b8259-457d-4e25-8fe4-7aa613baa012]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:20 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:20 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:20 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:20 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f20bc26-6608-445b-8ab0-82b1b23d37ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064, portal: 172.16.0.220,3260]
Aug 17 19:56:20 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:20 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6fd650-804f-408c-bf54-ea3c43f4d29f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[111ea8bf-b37f-41ee-9374-5841e2ce06bd]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:20 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:20 user nova-compute[72815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 (non-flash)
Aug 17 19:56:20 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:20 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:20 user nova-compute[72815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 (non-flash)
Aug 17 19:56:20 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ef894c-c3b2-4e3c-96a1-12547b12f5fe]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:56:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLhXSZsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:56:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] No VIF found with MAC fa:16:3e:7d:d0:02, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:56:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2b4385d7-bb92-44d7-b8b3-0ce50c305ce8 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.540s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] <== connect_volume: return (2231ms) {'type': 'block', 'scsi_wwn': '23430623463643336', 'path': '/dev/sdd'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430623463643336', 'path': '/dev/sdd'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:56:21 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lazy-loading 'flavor' on Instance uuid 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:56:21 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:21 user nova-compute[72815]:   <source dev="/dev/sdd"/>
Aug 17 19:56:21 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:56:21 user nova-compute[72815]:   <serial>b890a7d5-cdad-4ddd-855a-501363a5f064</serial>
Aug 17 19:56:21 user nova-compute[72815]: </disk>
Aug 17 19:56:21 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] No BDM found with device name hda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] No VIF found with MAC fa:16:3e:86:31:8b, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Acquiring lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG os_brick.utils [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f2217e33-05de-49b1-a169-b9be14ca2308 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.774s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef20721a-31ee-492f-a56c-85e3e5a9cc94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff67d255-3420-4372-bebc-dd51f9bd6bd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a9f5d9-803c-4306-a6fe-f63619bddb36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[705e30cc-c82a-424e-b7ca-8b3217a77cae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:56:22 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[64adb454-3ed4-46eb-8198-672c27994349]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG os_brick.utils [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:22 user nova-compute[72815]: INFO nova.compute.manager [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Swapping volume 6999e88d-0317-40b2-aad1-8314e34739a3 for d7e0e313-4a7a-48cc-b1c1-40db20fc568e
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:56:22 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:56:23 user nova-compute[72815]: INFO nova.compute.claims [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Claim successful on node user
Aug 17 19:56:23 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:23 user nova-compute[72815]: INFO nova.compute.manager [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Detaching volume b890a7d5-cdad-4ddd-855a-501363a5f064
Aug 17 19:56:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:56:23 user nova-compute[72815]: INFO nova.virt.block_device [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Attempting to driver detach volume b890a7d5-cdad-4ddd-855a-501363a5f064 from mountpoint /dev/vdb
Aug 17 19:56:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Attempting to detach device vdb from instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:56:23 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:23 user nova-compute[72815]:   <source dev="/dev/sdd"/>
Aug 17 19:56:23 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:56:23 user nova-compute[72815]:   <serial>b890a7d5-cdad-4ddd-855a-501363a5f064</serial>
Aug 17 19:56:23 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 19:56:23 user nova-compute[72815]: </disk>
Aug 17 19:56:23 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:56:23 user nova-compute[72815]: DEBUG nova.network.neutron [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:56:23 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:56:24 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Successfully detached device vdb from instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 from the persistent domain config.
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:56:24 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:24 user nova-compute[72815]:   <source dev="/dev/sdd"/>
Aug 17 19:56:24 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:56:24 user nova-compute[72815]:   <serial>b890a7d5-cdad-4ddd-855a-501363a5f064</serial>
Aug 17 19:56:24 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 19:56:24 user nova-compute[72815]: </disk>
Aug 17 19:56:24 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.compute.manager [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:56:24 user nova-compute[72815]: INFO nova.virt.block_device [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Booting with volume 8cbb8fea-e52b-47ef-a807-da463a755e74 at /dev/vda
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.utils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.policy [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce9def2151a447a68337ee04072fb748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0a431d27ae4571bc0c8687e61c6fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d8ad05-2cd6-4b17-8ab4-de62de7cce30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea1b2d2-2d0c-4ca8-b830-646a1498636a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34d0fa1-9ef6-4f05-876f-aeb86f7ae2ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ecf302-4f69-43ad-a007-86bb7f2bfc74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:56:24 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c50e9c8-095b-441f-842d-fae67370d0c8]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.utils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updating existing volume attachment record: bf6e2b9c-e1ae-44a8-998b-16195efb0518 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302184.4577687, 07f12446-7bbc-4b95-a79b-99d48fa23d63 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 19:56:24 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Successfully detached device vdb from instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 from the live domain config.
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLhXSZsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:24 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0122a454-600b-4c36-87d6-c2454785bed6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2419856-a82e-436b-b463-98620951462c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:24 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:24 user nova-compute[72815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 (non-flash)
Aug 17 19:56:24 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:24 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:24 user nova-compute[72815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 (non-flash)
Aug 17 19:56:24 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b43d3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064'): ({'sdd'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Removing single pathed devices sdd {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5eeb30-542c-49d5-8cd7-a278e46b2c93]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd5677e-55bb-413c-9a02-e0a9de74bef6]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Flushing IO for device /dev/sdd {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d3444b-396f-4f90-b260-635bdd5b4bcf]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[86528260-bff7-43d9-92c7-7a6c2ba314db]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[871427f2-5db8-4103-bf86-aae61fb7bcc7]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[048d1485-af7b-4fcf-9060-f40f2625793e]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064, portal: 172.16.0.220,3260]
Aug 17 19:56:24 user nova-compute[72815]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:24 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b890a7d5-cdad-4ddd-855a-501363a5f064 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7193f8a1-a18c-46ad-8341-7c01bf4702ea]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] <== disconnect_volume: return (317ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updating instance_info_cache with network_info: [{"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:24 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:56:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:25 user nova-compute[72815]: DEBUG nova.network.neutron [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Successfully created port: 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:56:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:25 user nova-compute[72815]: DEBUG nova.objects.instance [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lazy-loading 'flavor' on Instance uuid 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-760d7333-480d-4ec5-ba90-6fd96f575235 tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.080s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "interface-07f12446-7bbc-4b95-a79b-99d48fa23d63-1c8db3b8-c66d-4904-b304-7a60777894e2" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "interface-07f12446-7bbc-4b95-a79b-99d48fa23d63-1c8db3b8-c66d-4904-b304-7a60777894e2" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.008s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.objects.instance [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lazy-loading 'flavor' on Instance uuid 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13917815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13917815',id=9,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlbsB/SL5V5htublsblE53rgHUrd9eZYybyL04+s6cojpdS2pEXlZxF8DNM1ntLrIb/vWy80DhnU321He3lWo9jYEzzJlKGMilORzFpyhwZX5aQj4c3XPI1rKA578fn/A==',key_name='tempest-keypair-559643765',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:54:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8ba66c6a1bf494f867c7eec572d4880',ramdisk_id='',reservation_id='r-s5cxnqgd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-80529303',owner_user_name='tempest-TaggedAttachmentsTest-80529303-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a78dad1c02084db9b032efb86f7a503c',uuid=07f12446-7bbc-4b95-a79b-99d48fa23d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converting VIF {"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=1c8db3b8-c66d-4904-b304-7a60777894e2,network=Network(377fc621-e91d-4e06-b7b0-875b12adc28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8db3b8-c6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:27:4e:fb"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c8db3b8-c6"/></interface> {{(pid=72815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:27:4e:fb"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c8db3b8-c6"/></interface> {{(pid=72815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Attempting to detach device tap1c8db3b8-c6 from instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] detach device xml: <interface type="ethernet">
Aug 17 19:56:26 user nova-compute[72815]:   <mac address="fa:16:3e:27:4e:fb"/>
Aug 17 19:56:26 user nova-compute[72815]:   <model type="virtio"/>
Aug 17 19:56:26 user nova-compute[72815]:   <mtu size="1442"/>
Aug 17 19:56:26 user nova-compute[72815]:   <target dev="tap1c8db3b8-c6"/>
Aug 17 19:56:26 user nova-compute[72815]: </interface>
Aug 17 19:56:26 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.network.neutron [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Successfully updated port: 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:27:4e:fb"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c8db3b8-c6"/></interface> {{(pid=72815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:27:4e:fb"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c8db3b8-c6"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 17 19:56:26 user nova-compute[72815]:   <name>instance-00000009</name>
Aug 17 19:56:26 user nova-compute[72815]:   <uuid>07f12446-7bbc-4b95-a79b-99d48fa23d63</uuid>
Aug 17 19:56:26 user nova-compute[72815]:   <metadata>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:56:26 user nova-compute[72815]:   <nova:package version="0.0.0"/>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:name>tempest-device-tagging-server-13917815</nova:name>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:creationTime>2023-08-17 19:56:04</nova:creationTime>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:flavor name="m1.tiny">
Aug 17 19:56:26 user nova-compute[72815]:     <nova:memory>512</nova:memory>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:disk>1</nova:disk>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:swap>0</nova:swap>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:vcpus>1</nova:vcpus>
Aug 17 19:56:26 user nova-compute[72815]:   </nova:flavor>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:owner>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:user uuid="a78dad1c02084db9b032efb86f7a503c">tempest-TaggedAttachmentsTest-80529303-project-member</nova:user>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:project uuid="b8ba66c6a1bf494f867c7eec572d4880">tempest-TaggedAttachmentsTest-80529303</nova:project>
Aug 17 19:56:26 user nova-compute[72815]:   </nova:owner>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:ports>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:port uuid="011707bb-905e-49f1-8517-e58e6907e383">
Aug 17 19:56:26 user nova-compute[72815]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 19:56:26 user nova-compute[72815]:     </nova:port>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:port uuid="1c8db3b8-c66d-4904-b304-7a60777894e2">
Aug 17 19:56:26 user nova-compute[72815]:       <nova:ip type="fixed" address="10.10.10.46" ipVersion="4"/>
Aug 17 19:56:26 user nova-compute[72815]:     </nova:port>
Aug 17 19:56:26 user nova-compute[72815]:   </nova:ports>
Aug 17 19:56:26 user nova-compute[72815]: </nova:instance>
Aug 17 19:56:26 user nova-compute[72815]:   </metadata>
Aug 17 19:56:26 user nova-compute[72815]:   <memory unit='KiB'>524288</memory>
Aug 17 19:56:26 user nova-compute[72815]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 19:56:26 user nova-compute[72815]:   <vcpu placement='static'>1</vcpu>
Aug 17 19:56:26 user nova-compute[72815]:   <resource>
Aug 17 19:56:26 user nova-compute[72815]:     <partition>/machine</partition>
Aug 17 19:56:26 user nova-compute[72815]:   </resource>
Aug 17 19:56:26 user nova-compute[72815]:   <sysinfo type='smbios'>
Aug 17 19:56:26 user nova-compute[72815]:     <system>
Aug 17 19:56:26 user nova-compute[72815]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 19:56:26 user nova-compute[72815]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 19:56:26 user nova-compute[72815]:       <entry name='version'>0.0.0</entry>
Aug 17 19:56:26 user nova-compute[72815]:       <entry name='serial'>07f12446-7bbc-4b95-a79b-99d48fa23d63</entry>
Aug 17 19:56:26 user nova-compute[72815]:       <entry name='uuid'>07f12446-7bbc-4b95-a79b-99d48fa23d63</entry>
Aug 17 19:56:26 user nova-compute[72815]:       <entry name='family'>Virtual Machine</entry>
Aug 17 19:56:26 user nova-compute[72815]:     </system>
Aug 17 19:56:26 user nova-compute[72815]:   </sysinfo>
Aug 17 19:56:26 user nova-compute[72815]:   <os>
Aug 17 19:56:26 user nova-compute[72815]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 19:56:26 user nova-compute[72815]:     <boot dev='hd'/>
Aug 17 19:56:26 user nova-compute[72815]:     <smbios mode='sysinfo'/>
Aug 17 19:56:26 user nova-compute[72815]:   </os>
Aug 17 19:56:26 user nova-compute[72815]:   <features>
Aug 17 19:56:26 user nova-compute[72815]:     <acpi/>
Aug 17 19:56:26 user nova-compute[72815]:     <apic/>
Aug 17 19:56:26 user nova-compute[72815]:     <vmcoreinfo state='on'/>
Aug 17 19:56:26 user nova-compute[72815]:   </features>
Aug 17 19:56:26 user nova-compute[72815]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 19:56:26 user nova-compute[72815]:     <model fallback='forbid'>Nehalem</model>
Aug 17 19:56:26 user nova-compute[72815]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 19:56:26 user nova-compute[72815]:     <feature policy='require' name='vme'/>
Aug 17 19:56:26 user nova-compute[72815]:     <feature policy='require' name='x2apic'/>
Aug 17 19:56:26 user nova-compute[72815]:     <feature policy='require' name='hypervisor'/>
Aug 17 19:56:26 user nova-compute[72815]:   </cpu>
Aug 17 19:56:26 user nova-compute[72815]:   <clock offset='utc'>
Aug 17 19:56:26 user nova-compute[72815]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 19:56:26 user nova-compute[72815]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 19:56:26 user nova-compute[72815]:     <timer name='hpet' present='no'/>
Aug 17 19:56:26 user nova-compute[72815]:   </clock>
Aug 17 19:56:26 user nova-compute[72815]:   <on_poweroff>destroy</on_poweroff>
Aug 17 19:56:26 user nova-compute[72815]:   <on_reboot>restart</on_reboot>
Aug 17 19:56:26 user nova-compute[72815]:   <on_crash>destroy</on_crash>
Aug 17 19:56:26 user nova-compute[72815]:   <devices>
Aug 17 19:56:26 user nova-compute[72815]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 19:56:26 user nova-compute[72815]:     <disk type='file' device='disk'>
Aug 17 19:56:26 user nova-compute[72815]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 19:56:26 user nova-compute[72815]:       <source file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk' index='2'/>
Aug 17 19:56:26 user nova-compute[72815]:       <backingStore type='file' index='3'>
Aug 17 19:56:26 user nova-compute[72815]:         <format type='raw'/>
Aug 17 19:56:26 user nova-compute[72815]:         <source file='/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28'/>
Aug 17 19:56:26 user nova-compute[72815]:         <backingStore/>
Aug 17 19:56:26 user nova-compute[72815]:       </backingStore>
Aug 17 19:56:26 user nova-compute[72815]:       <target dev='vda' bus='virtio'/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='virtio-disk0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </disk>
Aug 17 19:56:26 user nova-compute[72815]:     <disk type='file' device='cdrom'>
Aug 17 19:56:26 user nova-compute[72815]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 19:56:26 user nova-compute[72815]:       <source file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk.config' index='1'/>
Aug 17 19:56:26 user nova-compute[72815]:       <backingStore/>
Aug 17 19:56:26 user nova-compute[72815]:       <target dev='hda' bus='ide'/>
Aug 17 19:56:26 user nova-compute[72815]:       <readonly/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='ide0-0-0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </disk>
Aug 17 19:56:26 user nova-compute[72815]:     <controller type='usb' index='0' model='none'>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='usb'/>
Aug 17 19:56:26 user nova-compute[72815]:     </controller>
Aug 17 19:56:26 user nova-compute[72815]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='pci.0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </controller>
Aug 17 19:56:26 user nova-compute[72815]:     <controller type='ide' index='0'>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='ide'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 19:56:26 user nova-compute[72815]:     </controller>
Aug 17 19:56:26 user nova-compute[72815]:     <interface type='ethernet'>
Aug 17 19:56:26 user nova-compute[72815]:       <mac address='fa:16:3e:86:31:8b'/>
Aug 17 19:56:26 user nova-compute[72815]:       <target dev='tap011707bb-90'/>
Aug 17 19:56:26 user nova-compute[72815]:       <model type='virtio'/>
Aug 17 19:56:26 user nova-compute[72815]:       <mtu size='1442'/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='net0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </interface>
Aug 17 19:56:26 user nova-compute[72815]:     <interface type='ethernet'>
Aug 17 19:56:26 user nova-compute[72815]:       <mac address='fa:16:3e:27:4e:fb'/>
Aug 17 19:56:26 user nova-compute[72815]:       <target dev='tap1c8db3b8-c6'/>
Aug 17 19:56:26 user nova-compute[72815]:       <model type='virtio'/>
Aug 17 19:56:26 user nova-compute[72815]:       <mtu size='1442'/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='net1'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </interface>
Aug 17 19:56:26 user nova-compute[72815]:     <serial type='pty'>
Aug 17 19:56:26 user nova-compute[72815]:       <source path='/dev/pts/8'/>
Aug 17 19:56:26 user nova-compute[72815]:       <log file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/console.log' append='off'/>
Aug 17 19:56:26 user nova-compute[72815]:       <target type='isa-serial' port='0'>
Aug 17 19:56:26 user nova-compute[72815]:         <model name='isa-serial'/>
Aug 17 19:56:26 user nova-compute[72815]:       </target>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='serial0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </serial>
Aug 17 19:56:26 user nova-compute[72815]:     <console type='pty' tty='/dev/pts/8'>
Aug 17 19:56:26 user nova-compute[72815]:       <source path='/dev/pts/8'/>
Aug 17 19:56:26 user nova-compute[72815]:       <log file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/console.log' append='off'/>
Aug 17 19:56:26 user nova-compute[72815]:       <target type='serial' port='0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='serial0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </console>
Aug 17 19:56:26 user nova-compute[72815]:     <input type='mouse' bus='ps2'>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='input0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </input>
Aug 17 19:56:26 user nova-compute[72815]:     <input type='keyboard' bus='ps2'>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='input1'/>
Aug 17 19:56:26 user nova-compute[72815]:     </input>
Aug 17 19:56:26 user nova-compute[72815]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 17 19:56:26 user nova-compute[72815]:       <listen type='address' address='0.0.0.0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </graphics>
Aug 17 19:56:26 user nova-compute[72815]:     <audio id='1' type='none'/>
Aug 17 19:56:26 user nova-compute[72815]:     <video>
Aug 17 19:56:26 user nova-compute[72815]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='video0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </video>
Aug 17 19:56:26 user nova-compute[72815]:     <memballoon model='virtio'>
Aug 17 19:56:26 user nova-compute[72815]:       <stats period='10'/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='balloon0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </memballoon>
Aug 17 19:56:26 user nova-compute[72815]:     <rng model='virtio'>
Aug 17 19:56:26 user nova-compute[72815]:       <backend model='random'>/dev/urandom</backend>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='rng0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </rng>
Aug 17 19:56:26 user nova-compute[72815]:   </devices>
Aug 17 19:56:26 user nova-compute[72815]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 19:56:26 user nova-compute[72815]:     <label>libvirt-07f12446-7bbc-4b95-a79b-99d48fa23d63</label>
Aug 17 19:56:26 user nova-compute[72815]:     <imagelabel>libvirt-07f12446-7bbc-4b95-a79b-99d48fa23d63</imagelabel>
Aug 17 19:56:26 user nova-compute[72815]:   </seclabel>
Aug 17 19:56:26 user nova-compute[72815]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 19:56:26 user nova-compute[72815]:     <label>+64055:+108</label>
Aug 17 19:56:26 user nova-compute[72815]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 19:56:26 user nova-compute[72815]:   </seclabel>
Aug 17 19:56:26 user nova-compute[72815]: </domain>
Aug 17 19:56:26 user nova-compute[72815]:  {{(pid=72815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 19:56:26 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Successfully detached device tap1c8db3b8-c6 from instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 from the persistent domain config.
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] (1/8): Attempting to detach device tap1c8db3b8-c6 with device alias net1 from instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] detach device xml: <interface type="ethernet">
Aug 17 19:56:26 user nova-compute[72815]:   <mac address="fa:16:3e:27:4e:fb"/>
Aug 17 19:56:26 user nova-compute[72815]:   <model type="virtio"/>
Aug 17 19:56:26 user nova-compute[72815]:   <mtu size="1442"/>
Aug 17 19:56:26 user nova-compute[72815]:   <target dev="tap1c8db3b8-c6"/>
Aug 17 19:56:26 user nova-compute[72815]: </interface>
Aug 17 19:56:26 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquired lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.network.neutron [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-1ed43b45-abc5-408b-8871-073131159394 req-4d5ff3b5-524f-4221-b03e-c18b0158d0d8 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-changed-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-1ed43b45-abc5-408b-8871-073131159394 req-4d5ff3b5-524f-4221-b03e-c18b0158d0d8 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Refreshing instance network info cache due to event network-changed-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ed43b45-abc5-408b-8871-073131159394 req-4d5ff3b5-524f-4221-b03e-c18b0158d0d8 service nova] Acquiring lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.network.neutron [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302186.4748733, 07f12446-7bbc-4b95-a79b-99d48fa23d63 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Start waiting for the detach event from libvirt for device tap1c8db3b8-c6 with device alias net1 for instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:27:4e:fb"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c8db3b8-c6"/></interface> {{(pid=72815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:27:4e:fb"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c8db3b8-c6"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 17 19:56:26 user nova-compute[72815]:   <name>instance-00000009</name>
Aug 17 19:56:26 user nova-compute[72815]:   <uuid>07f12446-7bbc-4b95-a79b-99d48fa23d63</uuid>
Aug 17 19:56:26 user nova-compute[72815]:   <metadata>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:56:26 user nova-compute[72815]:   <nova:package version="0.0.0"/>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:name>tempest-device-tagging-server-13917815</nova:name>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:creationTime>2023-08-17 19:56:04</nova:creationTime>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:flavor name="m1.tiny">
Aug 17 19:56:26 user nova-compute[72815]:     <nova:memory>512</nova:memory>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:disk>1</nova:disk>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:swap>0</nova:swap>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:vcpus>1</nova:vcpus>
Aug 17 19:56:26 user nova-compute[72815]:   </nova:flavor>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:owner>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:user uuid="a78dad1c02084db9b032efb86f7a503c">tempest-TaggedAttachmentsTest-80529303-project-member</nova:user>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:project uuid="b8ba66c6a1bf494f867c7eec572d4880">tempest-TaggedAttachmentsTest-80529303</nova:project>
Aug 17 19:56:26 user nova-compute[72815]:   </nova:owner>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:ports>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:port uuid="011707bb-905e-49f1-8517-e58e6907e383">
Aug 17 19:56:26 user nova-compute[72815]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 19:56:26 user nova-compute[72815]:     </nova:port>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:port uuid="1c8db3b8-c66d-4904-b304-7a60777894e2">
Aug 17 19:56:26 user nova-compute[72815]:       <nova:ip type="fixed" address="10.10.10.46" ipVersion="4"/>
Aug 17 19:56:26 user nova-compute[72815]:     </nova:port>
Aug 17 19:56:26 user nova-compute[72815]:   </nova:ports>
Aug 17 19:56:26 user nova-compute[72815]: </nova:instance>
Aug 17 19:56:26 user nova-compute[72815]:   </metadata>
Aug 17 19:56:26 user nova-compute[72815]:   <memory unit='KiB'>524288</memory>
Aug 17 19:56:26 user nova-compute[72815]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 19:56:26 user nova-compute[72815]:   <vcpu placement='static'>1</vcpu>
Aug 17 19:56:26 user nova-compute[72815]:   <resource>
Aug 17 19:56:26 user nova-compute[72815]:     <partition>/machine</partition>
Aug 17 19:56:26 user nova-compute[72815]:   </resource>
Aug 17 19:56:26 user nova-compute[72815]:   <sysinfo type='smbios'>
Aug 17 19:56:26 user nova-compute[72815]:     <system>
Aug 17 19:56:26 user nova-compute[72815]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 19:56:26 user nova-compute[72815]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 19:56:26 user nova-compute[72815]:       <entry name='version'>0.0.0</entry>
Aug 17 19:56:26 user nova-compute[72815]:       <entry name='serial'>07f12446-7bbc-4b95-a79b-99d48fa23d63</entry>
Aug 17 19:56:26 user nova-compute[72815]:       <entry name='uuid'>07f12446-7bbc-4b95-a79b-99d48fa23d63</entry>
Aug 17 19:56:26 user nova-compute[72815]:       <entry name='family'>Virtual Machine</entry>
Aug 17 19:56:26 user nova-compute[72815]:     </system>
Aug 17 19:56:26 user nova-compute[72815]:   </sysinfo>
Aug 17 19:56:26 user nova-compute[72815]:   <os>
Aug 17 19:56:26 user nova-compute[72815]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 19:56:26 user nova-compute[72815]:     <boot dev='hd'/>
Aug 17 19:56:26 user nova-compute[72815]:     <smbios mode='sysinfo'/>
Aug 17 19:56:26 user nova-compute[72815]:   </os>
Aug 17 19:56:26 user nova-compute[72815]:   <features>
Aug 17 19:56:26 user nova-compute[72815]:     <acpi/>
Aug 17 19:56:26 user nova-compute[72815]:     <apic/>
Aug 17 19:56:26 user nova-compute[72815]:     <vmcoreinfo state='on'/>
Aug 17 19:56:26 user nova-compute[72815]:   </features>
Aug 17 19:56:26 user nova-compute[72815]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 19:56:26 user nova-compute[72815]:     <model fallback='forbid'>Nehalem</model>
Aug 17 19:56:26 user nova-compute[72815]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 19:56:26 user nova-compute[72815]:     <feature policy='require' name='vme'/>
Aug 17 19:56:26 user nova-compute[72815]:     <feature policy='require' name='x2apic'/>
Aug 17 19:56:26 user nova-compute[72815]:     <feature policy='require' name='hypervisor'/>
Aug 17 19:56:26 user nova-compute[72815]:   </cpu>
Aug 17 19:56:26 user nova-compute[72815]:   <clock offset='utc'>
Aug 17 19:56:26 user nova-compute[72815]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 19:56:26 user nova-compute[72815]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 19:56:26 user nova-compute[72815]:     <timer name='hpet' present='no'/>
Aug 17 19:56:26 user nova-compute[72815]:   </clock>
Aug 17 19:56:26 user nova-compute[72815]:   <on_poweroff>destroy</on_poweroff>
Aug 17 19:56:26 user nova-compute[72815]:   <on_reboot>restart</on_reboot>
Aug 17 19:56:26 user nova-compute[72815]:   <on_crash>destroy</on_crash>
Aug 17 19:56:26 user nova-compute[72815]:   <devices>
Aug 17 19:56:26 user nova-compute[72815]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 19:56:26 user nova-compute[72815]:     <disk type='file' device='disk'>
Aug 17 19:56:26 user nova-compute[72815]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 19:56:26 user nova-compute[72815]:       <source file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk' index='2'/>
Aug 17 19:56:26 user nova-compute[72815]:       <backingStore type='file' index='3'>
Aug 17 19:56:26 user nova-compute[72815]:         <format type='raw'/>
Aug 17 19:56:26 user nova-compute[72815]:         <source file='/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28'/>
Aug 17 19:56:26 user nova-compute[72815]:         <backingStore/>
Aug 17 19:56:26 user nova-compute[72815]:       </backingStore>
Aug 17 19:56:26 user nova-compute[72815]:       <target dev='vda' bus='virtio'/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='virtio-disk0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </disk>
Aug 17 19:56:26 user nova-compute[72815]:     <disk type='file' device='cdrom'>
Aug 17 19:56:26 user nova-compute[72815]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 19:56:26 user nova-compute[72815]:       <source file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk.config' index='1'/>
Aug 17 19:56:26 user nova-compute[72815]:       <backingStore/>
Aug 17 19:56:26 user nova-compute[72815]:       <target dev='hda' bus='ide'/>
Aug 17 19:56:26 user nova-compute[72815]:       <readonly/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='ide0-0-0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </disk>
Aug 17 19:56:26 user nova-compute[72815]:     <controller type='usb' index='0' model='none'>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='usb'/>
Aug 17 19:56:26 user nova-compute[72815]:     </controller>
Aug 17 19:56:26 user nova-compute[72815]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='pci.0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </controller>
Aug 17 19:56:26 user nova-compute[72815]:     <controller type='ide' index='0'>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='ide'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 19:56:26 user nova-compute[72815]:     </controller>
Aug 17 19:56:26 user nova-compute[72815]:     <interface type='ethernet'>
Aug 17 19:56:26 user nova-compute[72815]:       <mac address='fa:16:3e:86:31:8b'/>
Aug 17 19:56:26 user nova-compute[72815]:       <target dev='tap011707bb-90'/>
Aug 17 19:56:26 user nova-compute[72815]:       <model type='virtio'/>
Aug 17 19:56:26 user nova-compute[72815]:       <mtu size='1442'/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='net0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </interface>
Aug 17 19:56:26 user nova-compute[72815]:     <serial type='pty'>
Aug 17 19:56:26 user nova-compute[72815]:       <source path='/dev/pts/8'/>
Aug 17 19:56:26 user nova-compute[72815]:       <log file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/console.log' append='off'/>
Aug 17 19:56:26 user nova-compute[72815]:       <target type='isa-serial' port='0'>
Aug 17 19:56:26 user nova-compute[72815]:         <model name='isa-serial'/>
Aug 17 19:56:26 user nova-compute[72815]:       </target>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='serial0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </serial>
Aug 17 19:56:26 user nova-compute[72815]:     <console type='pty' tty='/dev/pts/8'>
Aug 17 19:56:26 user nova-compute[72815]:       <source path='/dev/pts/8'/>
Aug 17 19:56:26 user nova-compute[72815]:       <log file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/console.log' append='off'/>
Aug 17 19:56:26 user nova-compute[72815]:       <target type='serial' port='0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='serial0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </console>
Aug 17 19:56:26 user nova-compute[72815]:     <input type='mouse' bus='ps2'>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='input0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </input>
Aug 17 19:56:26 user nova-compute[72815]:     <input type='keyboard' bus='ps2'>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='input1'/>
Aug 17 19:56:26 user nova-compute[72815]:     </input>
Aug 17 19:56:26 user nova-compute[72815]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 17 19:56:26 user nova-compute[72815]:       <listen type='address' address='0.0.0.0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </graphics>
Aug 17 19:56:26 user nova-compute[72815]:     <audio id='1' type='none'/>
Aug 17 19:56:26 user nova-compute[72815]:     <video>
Aug 17 19:56:26 user nova-compute[72815]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='video0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </video>
Aug 17 19:56:26 user nova-compute[72815]:     <memballoon model='virtio'>
Aug 17 19:56:26 user nova-compute[72815]:       <stats period='10'/>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='balloon0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </memballoon>
Aug 17 19:56:26 user nova-compute[72815]:     <rng model='virtio'>
Aug 17 19:56:26 user nova-compute[72815]:       <backend model='random'>/dev/urandom</backend>
Aug 17 19:56:26 user nova-compute[72815]:       <alias name='rng0'/>
Aug 17 19:56:26 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 19:56:26 user nova-compute[72815]:     </rng>
Aug 17 19:56:26 user nova-compute[72815]:   </devices>
Aug 17 19:56:26 user nova-compute[72815]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 19:56:26 user nova-compute[72815]:     <label>libvirt-07f12446-7bbc-4b95-a79b-99d48fa23d63</label>
Aug 17 19:56:26 user nova-compute[72815]:     <imagelabel>libvirt-07f12446-7bbc-4b95-a79b-99d48fa23d63</imagelabel>
Aug 17 19:56:26 user nova-compute[72815]:   </seclabel>
Aug 17 19:56:26 user nova-compute[72815]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 19:56:26 user nova-compute[72815]:     <label>+64055:+108</label>
Aug 17 19:56:26 user nova-compute[72815]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 19:56:26 user nova-compute[72815]:   </seclabel>
Aug 17 19:56:26 user nova-compute[72815]: </domain>
Aug 17 19:56:26 user nova-compute[72815]:  {{(pid=72815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 19:56:26 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Successfully detached device tap1c8db3b8-c6 from instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 from the live domain config.
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13917815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13917815',id=9,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlbsB/SL5V5htublsblE53rgHUrd9eZYybyL04+s6cojpdS2pEXlZxF8DNM1ntLrIb/vWy80DhnU321He3lWo9jYEzzJlKGMilORzFpyhwZX5aQj4c3XPI1rKA578fn/A==',key_name='tempest-keypair-559643765',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:54:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8ba66c6a1bf494f867c7eec572d4880',ramdisk_id='',reservation_id='r-s5cxnqgd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-80529303',owner_user_name='tempest-TaggedAttachmentsTest-80529303-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a78dad1c02084db9b032efb86f7a503c',uuid=07f12446-7bbc-4b95-a79b-99d48fa23d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converting VIF {"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=1c8db3b8-c66d-4904-b304-7a60777894e2,network=Network(377fc621-e91d-4e06-b7b0-875b12adc28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8db3b8-c6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG os_vif [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=1c8db3b8-c66d-4904-b304-7a60777894e2,network=Network(377fc621-e91d-4e06-b7b0-875b12adc28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8db3b8-c6') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c8db3b8-c6, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:26 user nova-compute[72815]: INFO os_vif [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=1c8db3b8-c66d-4904-b304-7a60777894e2,network=Network(377fc621-e91d-4e06-b7b0-875b12adc28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8db3b8-c6')
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:56:26 user nova-compute[72815]:   <nova:package version="0.0.0"/>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:name>tempest-device-tagging-server-13917815</nova:name>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:creationTime>2023-08-17 19:56:26</nova:creationTime>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:flavor name="m1.tiny">
Aug 17 19:56:26 user nova-compute[72815]:     <nova:memory>512</nova:memory>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:disk>1</nova:disk>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:swap>0</nova:swap>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:vcpus>1</nova:vcpus>
Aug 17 19:56:26 user nova-compute[72815]:   </nova:flavor>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:owner>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:user uuid="a78dad1c02084db9b032efb86f7a503c">tempest-TaggedAttachmentsTest-80529303-project-member</nova:user>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:project uuid="b8ba66c6a1bf494f867c7eec572d4880">tempest-TaggedAttachmentsTest-80529303</nova:project>
Aug 17 19:56:26 user nova-compute[72815]:   </nova:owner>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:56:26 user nova-compute[72815]:   <nova:ports>
Aug 17 19:56:26 user nova-compute[72815]:     <nova:port uuid="011707bb-905e-49f1-8517-e58e6907e383">
Aug 17 19:56:26 user nova-compute[72815]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 19:56:26 user nova-compute[72815]:     </nova:port>
Aug 17 19:56:26 user nova-compute[72815]:   </nova:ports>
Aug 17 19:56:26 user nova-compute[72815]: </nova:instance>
Aug 17 19:56:26 user nova-compute[72815]:  {{(pid=72815) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-8f5ee840-7627-492b-97a5-eeeb69d7e889 req-287f1727-06c7-4f51-af03-145a5ea3dc70 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-vif-unplugged-1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8f5ee840-7627-492b-97a5-eeeb69d7e889 req-287f1727-06c7-4f51-af03-145a5ea3dc70 service nova] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8f5ee840-7627-492b-97a5-eeeb69d7e889 req-287f1727-06c7-4f51-af03-145a5ea3dc70 service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8f5ee840-7627-492b-97a5-eeeb69d7e889 req-287f1727-06c7-4f51-af03-145a5ea3dc70 service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-8f5ee840-7627-492b-97a5-eeeb69d7e889 req-287f1727-06c7-4f51-af03-145a5ea3dc70 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] No waiting events found dispatching network-vif-unplugged-1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:26 user nova-compute[72815]: WARNING nova.compute.manager [req-8f5ee840-7627-492b-97a5-eeeb69d7e889 req-287f1727-06c7-4f51-af03-145a5ea3dc70 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received unexpected event network-vif-unplugged-1c8db3b8-c66d-4904-b304-7a60777894e2 for instance with vm_state active and task_state None.
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:56:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG nova.network.neutron [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updating instance_info_cache with network_info: [{"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Releasing lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG nova.compute.manager [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Instance network_info: |[{"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ed43b45-abc5-408b-8871-073131159394 req-4d5ff3b5-524f-4221-b03e-c18b0158d0d8 service nova] Acquired lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG nova.network.neutron [req-1ed43b45-abc5-408b-8871-073131159394 req-4d5ff3b5-524f-4221-b03e-c18b0158d0d8 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Refreshing network info cache for port 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquired lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.network.neutron [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.network.neutron [req-1ed43b45-abc5-408b-8871-073131159394 req-4d5ff3b5-524f-4221-b03e-c18b0158d0d8 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updated VIF entry in instance network info cache for port 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.network.neutron [req-1ed43b45-abc5-408b-8871-073131159394 req-4d5ff3b5-524f-4221-b03e-c18b0158d0d8 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updating instance_info_cache with network_info: [{"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ed43b45-abc5-408b-8871-073131159394 req-4d5ff3b5-524f-4221-b03e-c18b0158d0d8 service nova] Releasing lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-vif-deleted-1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:28 user nova-compute[72815]: INFO nova.compute.manager [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Neutron deleted interface 1c8db3b8-c66d-4904-b304-7a60777894e2; detaching it from the instance and deleting it from the info cache
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.network.neutron [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Updating instance_info_cache with network_info: [{"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.objects.instance [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] Lazy-loading 'system_metadata' on Instance uuid 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.objects.instance [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] Lazy-loading 'flavor' on Instance uuid 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13917815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13917815',id=9,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlbsB/SL5V5htublsblE53rgHUrd9eZYybyL04+s6cojpdS2pEXlZxF8DNM1ntLrIb/vWy80DhnU321He3lWo9jYEzzJlKGMilORzFpyhwZX5aQj4c3XPI1rKA578fn/A==',key_name='tempest-keypair-559643765',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:54:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8ba66c6a1bf494f867c7eec572d4880',ramdisk_id='',reservation_id='r-s5cxnqgd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-80529303',owner_user_name='tempest-TaggedAttachmentsTest-80529303-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a78dad1c02084db9b032efb86f7a503c',uuid=07f12446-7bbc-4b95-a79b-99d48fa23d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.network.os_vif_util [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] Converting VIF {"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.network.os_vif_util [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=1c8db3b8-c66d-4904-b304-7a60777894e2,network=Network(377fc621-e91d-4e06-b7b0-875b12adc28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8db3b8-c6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:27:4e:fb"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c8db3b8-c6"/></interface> {{(pid=72815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:27:4e:fb"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c8db3b8-c6"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 17 19:56:28 user nova-compute[72815]:   <name>instance-00000009</name>
Aug 17 19:56:28 user nova-compute[72815]:   <uuid>07f12446-7bbc-4b95-a79b-99d48fa23d63</uuid>
Aug 17 19:56:28 user nova-compute[72815]:   <metadata>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:56:28 user nova-compute[72815]:   <nova:package version="0.0.0"/>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:name>tempest-device-tagging-server-13917815</nova:name>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:creationTime>2023-08-17 19:56:26</nova:creationTime>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:flavor name="m1.tiny">
Aug 17 19:56:28 user nova-compute[72815]:     <nova:memory>512</nova:memory>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:disk>1</nova:disk>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:swap>0</nova:swap>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:vcpus>1</nova:vcpus>
Aug 17 19:56:28 user nova-compute[72815]:   </nova:flavor>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:owner>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:user uuid="a78dad1c02084db9b032efb86f7a503c">tempest-TaggedAttachmentsTest-80529303-project-member</nova:user>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:project uuid="b8ba66c6a1bf494f867c7eec572d4880">tempest-TaggedAttachmentsTest-80529303</nova:project>
Aug 17 19:56:28 user nova-compute[72815]:   </nova:owner>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:ports>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:port uuid="011707bb-905e-49f1-8517-e58e6907e383">
Aug 17 19:56:28 user nova-compute[72815]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 19:56:28 user nova-compute[72815]:     </nova:port>
Aug 17 19:56:28 user nova-compute[72815]:   </nova:ports>
Aug 17 19:56:28 user nova-compute[72815]: </nova:instance>
Aug 17 19:56:28 user nova-compute[72815]:   </metadata>
Aug 17 19:56:28 user nova-compute[72815]:   <memory unit='KiB'>524288</memory>
Aug 17 19:56:28 user nova-compute[72815]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 19:56:28 user nova-compute[72815]:   <vcpu placement='static'>1</vcpu>
Aug 17 19:56:28 user nova-compute[72815]:   <resource>
Aug 17 19:56:28 user nova-compute[72815]:     <partition>/machine</partition>
Aug 17 19:56:28 user nova-compute[72815]:   </resource>
Aug 17 19:56:28 user nova-compute[72815]:   <sysinfo type='smbios'>
Aug 17 19:56:28 user nova-compute[72815]:     <system>
Aug 17 19:56:28 user nova-compute[72815]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 19:56:28 user nova-compute[72815]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 19:56:28 user nova-compute[72815]:       <entry name='version'>0.0.0</entry>
Aug 17 19:56:28 user nova-compute[72815]:       <entry name='serial'>07f12446-7bbc-4b95-a79b-99d48fa23d63</entry>
Aug 17 19:56:28 user nova-compute[72815]:       <entry name='uuid'>07f12446-7bbc-4b95-a79b-99d48fa23d63</entry>
Aug 17 19:56:28 user nova-compute[72815]:       <entry name='family'>Virtual Machine</entry>
Aug 17 19:56:28 user nova-compute[72815]:     </system>
Aug 17 19:56:28 user nova-compute[72815]:   </sysinfo>
Aug 17 19:56:28 user nova-compute[72815]:   <os>
Aug 17 19:56:28 user nova-compute[72815]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 19:56:28 user nova-compute[72815]:     <boot dev='hd'/>
Aug 17 19:56:28 user nova-compute[72815]:     <smbios mode='sysinfo'/>
Aug 17 19:56:28 user nova-compute[72815]:   </os>
Aug 17 19:56:28 user nova-compute[72815]:   <features>
Aug 17 19:56:28 user nova-compute[72815]:     <acpi/>
Aug 17 19:56:28 user nova-compute[72815]:     <apic/>
Aug 17 19:56:28 user nova-compute[72815]:     <vmcoreinfo state='on'/>
Aug 17 19:56:28 user nova-compute[72815]:   </features>
Aug 17 19:56:28 user nova-compute[72815]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 19:56:28 user nova-compute[72815]:     <model fallback='forbid'>Nehalem</model>
Aug 17 19:56:28 user nova-compute[72815]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 19:56:28 user nova-compute[72815]:     <feature policy='require' name='vme'/>
Aug 17 19:56:28 user nova-compute[72815]:     <feature policy='require' name='x2apic'/>
Aug 17 19:56:28 user nova-compute[72815]:     <feature policy='require' name='hypervisor'/>
Aug 17 19:56:28 user nova-compute[72815]:   </cpu>
Aug 17 19:56:28 user nova-compute[72815]:   <clock offset='utc'>
Aug 17 19:56:28 user nova-compute[72815]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 19:56:28 user nova-compute[72815]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 19:56:28 user nova-compute[72815]:     <timer name='hpet' present='no'/>
Aug 17 19:56:28 user nova-compute[72815]:   </clock>
Aug 17 19:56:28 user nova-compute[72815]:   <on_poweroff>destroy</on_poweroff>
Aug 17 19:56:28 user nova-compute[72815]:   <on_reboot>restart</on_reboot>
Aug 17 19:56:28 user nova-compute[72815]:   <on_crash>destroy</on_crash>
Aug 17 19:56:28 user nova-compute[72815]:   <devices>
Aug 17 19:56:28 user nova-compute[72815]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 19:56:28 user nova-compute[72815]:     <disk type='file' device='disk'>
Aug 17 19:56:28 user nova-compute[72815]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 19:56:28 user nova-compute[72815]:       <source file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk' index='2'/>
Aug 17 19:56:28 user nova-compute[72815]:       <backingStore type='file' index='3'>
Aug 17 19:56:28 user nova-compute[72815]:         <format type='raw'/>
Aug 17 19:56:28 user nova-compute[72815]:         <source file='/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28'/>
Aug 17 19:56:28 user nova-compute[72815]:         <backingStore/>
Aug 17 19:56:28 user nova-compute[72815]:       </backingStore>
Aug 17 19:56:28 user nova-compute[72815]:       <target dev='vda' bus='virtio'/>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='virtio-disk0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </disk>
Aug 17 19:56:28 user nova-compute[72815]:     <disk type='file' device='cdrom'>
Aug 17 19:56:28 user nova-compute[72815]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 19:56:28 user nova-compute[72815]:       <source file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk.config' index='1'/>
Aug 17 19:56:28 user nova-compute[72815]:       <backingStore/>
Aug 17 19:56:28 user nova-compute[72815]:       <target dev='hda' bus='ide'/>
Aug 17 19:56:28 user nova-compute[72815]:       <readonly/>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='ide0-0-0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </disk>
Aug 17 19:56:28 user nova-compute[72815]:     <controller type='usb' index='0' model='none'>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='usb'/>
Aug 17 19:56:28 user nova-compute[72815]:     </controller>
Aug 17 19:56:28 user nova-compute[72815]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='pci.0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </controller>
Aug 17 19:56:28 user nova-compute[72815]:     <controller type='ide' index='0'>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='ide'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 19:56:28 user nova-compute[72815]:     </controller>
Aug 17 19:56:28 user nova-compute[72815]:     <interface type='ethernet'>
Aug 17 19:56:28 user nova-compute[72815]:       <mac address='fa:16:3e:86:31:8b'/>
Aug 17 19:56:28 user nova-compute[72815]:       <target dev='tap011707bb-90'/>
Aug 17 19:56:28 user nova-compute[72815]:       <model type='virtio'/>
Aug 17 19:56:28 user nova-compute[72815]:       <mtu size='1442'/>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='net0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </interface>
Aug 17 19:56:28 user nova-compute[72815]:     <serial type='pty'>
Aug 17 19:56:28 user nova-compute[72815]:       <source path='/dev/pts/8'/>
Aug 17 19:56:28 user nova-compute[72815]:       <log file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/console.log' append='off'/>
Aug 17 19:56:28 user nova-compute[72815]:       <target type='isa-serial' port='0'>
Aug 17 19:56:28 user nova-compute[72815]:         <model name='isa-serial'/>
Aug 17 19:56:28 user nova-compute[72815]:       </target>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='serial0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </serial>
Aug 17 19:56:28 user nova-compute[72815]:     <console type='pty' tty='/dev/pts/8'>
Aug 17 19:56:28 user nova-compute[72815]:       <source path='/dev/pts/8'/>
Aug 17 19:56:28 user nova-compute[72815]:       <log file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/console.log' append='off'/>
Aug 17 19:56:28 user nova-compute[72815]:       <target type='serial' port='0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='serial0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </console>
Aug 17 19:56:28 user nova-compute[72815]:     <input type='mouse' bus='ps2'>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='input0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </input>
Aug 17 19:56:28 user nova-compute[72815]:     <input type='keyboard' bus='ps2'>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='input1'/>
Aug 17 19:56:28 user nova-compute[72815]:     </input>
Aug 17 19:56:28 user nova-compute[72815]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 17 19:56:28 user nova-compute[72815]:       <listen type='address' address='0.0.0.0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </graphics>
Aug 17 19:56:28 user nova-compute[72815]:     <audio id='1' type='none'/>
Aug 17 19:56:28 user nova-compute[72815]:     <video>
Aug 17 19:56:28 user nova-compute[72815]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='video0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </video>
Aug 17 19:56:28 user nova-compute[72815]:     <memballoon model='virtio'>
Aug 17 19:56:28 user nova-compute[72815]:       <stats period='10'/>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='balloon0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </memballoon>
Aug 17 19:56:28 user nova-compute[72815]:     <rng model='virtio'>
Aug 17 19:56:28 user nova-compute[72815]:       <backend model='random'>/dev/urandom</backend>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='rng0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </rng>
Aug 17 19:56:28 user nova-compute[72815]:   </devices>
Aug 17 19:56:28 user nova-compute[72815]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 19:56:28 user nova-compute[72815]:     <label>libvirt-07f12446-7bbc-4b95-a79b-99d48fa23d63</label>
Aug 17 19:56:28 user nova-compute[72815]:     <imagelabel>libvirt-07f12446-7bbc-4b95-a79b-99d48fa23d63</imagelabel>
Aug 17 19:56:28 user nova-compute[72815]:   </seclabel>
Aug 17 19:56:28 user nova-compute[72815]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 19:56:28 user nova-compute[72815]:     <label>+64055:+108</label>
Aug 17 19:56:28 user nova-compute[72815]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 19:56:28 user nova-compute[72815]:   </seclabel>
Aug 17 19:56:28 user nova-compute[72815]: </domain>
Aug 17 19:56:28 user nova-compute[72815]:  {{(pid=72815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:27:4e:fb"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c8db3b8-c6"/></interface> {{(pid=72815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:27:4e:fb"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c8db3b8-c6"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 17 19:56:28 user nova-compute[72815]:   <name>instance-00000009</name>
Aug 17 19:56:28 user nova-compute[72815]:   <uuid>07f12446-7bbc-4b95-a79b-99d48fa23d63</uuid>
Aug 17 19:56:28 user nova-compute[72815]:   <metadata>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:56:28 user nova-compute[72815]:   <nova:package version="0.0.0"/>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:name>tempest-device-tagging-server-13917815</nova:name>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:creationTime>2023-08-17 19:56:26</nova:creationTime>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:flavor name="m1.tiny">
Aug 17 19:56:28 user nova-compute[72815]:     <nova:memory>512</nova:memory>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:disk>1</nova:disk>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:swap>0</nova:swap>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:vcpus>1</nova:vcpus>
Aug 17 19:56:28 user nova-compute[72815]:   </nova:flavor>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:owner>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:user uuid="a78dad1c02084db9b032efb86f7a503c">tempest-TaggedAttachmentsTest-80529303-project-member</nova:user>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:project uuid="b8ba66c6a1bf494f867c7eec572d4880">tempest-TaggedAttachmentsTest-80529303</nova:project>
Aug 17 19:56:28 user nova-compute[72815]:   </nova:owner>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:ports>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:port uuid="011707bb-905e-49f1-8517-e58e6907e383">
Aug 17 19:56:28 user nova-compute[72815]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 19:56:28 user nova-compute[72815]:     </nova:port>
Aug 17 19:56:28 user nova-compute[72815]:   </nova:ports>
Aug 17 19:56:28 user nova-compute[72815]: </nova:instance>
Aug 17 19:56:28 user nova-compute[72815]:   </metadata>
Aug 17 19:56:28 user nova-compute[72815]:   <memory unit='KiB'>524288</memory>
Aug 17 19:56:28 user nova-compute[72815]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 19:56:28 user nova-compute[72815]:   <vcpu placement='static'>1</vcpu>
Aug 17 19:56:28 user nova-compute[72815]:   <resource>
Aug 17 19:56:28 user nova-compute[72815]:     <partition>/machine</partition>
Aug 17 19:56:28 user nova-compute[72815]:   </resource>
Aug 17 19:56:28 user nova-compute[72815]:   <sysinfo type='smbios'>
Aug 17 19:56:28 user nova-compute[72815]:     <system>
Aug 17 19:56:28 user nova-compute[72815]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 19:56:28 user nova-compute[72815]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 19:56:28 user nova-compute[72815]:       <entry name='version'>0.0.0</entry>
Aug 17 19:56:28 user nova-compute[72815]:       <entry name='serial'>07f12446-7bbc-4b95-a79b-99d48fa23d63</entry>
Aug 17 19:56:28 user nova-compute[72815]:       <entry name='uuid'>07f12446-7bbc-4b95-a79b-99d48fa23d63</entry>
Aug 17 19:56:28 user nova-compute[72815]:       <entry name='family'>Virtual Machine</entry>
Aug 17 19:56:28 user nova-compute[72815]:     </system>
Aug 17 19:56:28 user nova-compute[72815]:   </sysinfo>
Aug 17 19:56:28 user nova-compute[72815]:   <os>
Aug 17 19:56:28 user nova-compute[72815]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 19:56:28 user nova-compute[72815]:     <boot dev='hd'/>
Aug 17 19:56:28 user nova-compute[72815]:     <smbios mode='sysinfo'/>
Aug 17 19:56:28 user nova-compute[72815]:   </os>
Aug 17 19:56:28 user nova-compute[72815]:   <features>
Aug 17 19:56:28 user nova-compute[72815]:     <acpi/>
Aug 17 19:56:28 user nova-compute[72815]:     <apic/>
Aug 17 19:56:28 user nova-compute[72815]:     <vmcoreinfo state='on'/>
Aug 17 19:56:28 user nova-compute[72815]:   </features>
Aug 17 19:56:28 user nova-compute[72815]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 19:56:28 user nova-compute[72815]:     <model fallback='forbid'>Nehalem</model>
Aug 17 19:56:28 user nova-compute[72815]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 19:56:28 user nova-compute[72815]:     <feature policy='require' name='vme'/>
Aug 17 19:56:28 user nova-compute[72815]:     <feature policy='require' name='x2apic'/>
Aug 17 19:56:28 user nova-compute[72815]:     <feature policy='require' name='hypervisor'/>
Aug 17 19:56:28 user nova-compute[72815]:   </cpu>
Aug 17 19:56:28 user nova-compute[72815]:   <clock offset='utc'>
Aug 17 19:56:28 user nova-compute[72815]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 19:56:28 user nova-compute[72815]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 19:56:28 user nova-compute[72815]:     <timer name='hpet' present='no'/>
Aug 17 19:56:28 user nova-compute[72815]:   </clock>
Aug 17 19:56:28 user nova-compute[72815]:   <on_poweroff>destroy</on_poweroff>
Aug 17 19:56:28 user nova-compute[72815]:   <on_reboot>restart</on_reboot>
Aug 17 19:56:28 user nova-compute[72815]:   <on_crash>destroy</on_crash>
Aug 17 19:56:28 user nova-compute[72815]:   <devices>
Aug 17 19:56:28 user nova-compute[72815]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 19:56:28 user nova-compute[72815]:     <disk type='file' device='disk'>
Aug 17 19:56:28 user nova-compute[72815]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 19:56:28 user nova-compute[72815]:       <source file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk' index='2'/>
Aug 17 19:56:28 user nova-compute[72815]:       <backingStore type='file' index='3'>
Aug 17 19:56:28 user nova-compute[72815]:         <format type='raw'/>
Aug 17 19:56:28 user nova-compute[72815]:         <source file='/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28'/>
Aug 17 19:56:28 user nova-compute[72815]:         <backingStore/>
Aug 17 19:56:28 user nova-compute[72815]:       </backingStore>
Aug 17 19:56:28 user nova-compute[72815]:       <target dev='vda' bus='virtio'/>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='virtio-disk0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </disk>
Aug 17 19:56:28 user nova-compute[72815]:     <disk type='file' device='cdrom'>
Aug 17 19:56:28 user nova-compute[72815]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 19:56:28 user nova-compute[72815]:       <source file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/disk.config' index='1'/>
Aug 17 19:56:28 user nova-compute[72815]:       <backingStore/>
Aug 17 19:56:28 user nova-compute[72815]:       <target dev='hda' bus='ide'/>
Aug 17 19:56:28 user nova-compute[72815]:       <readonly/>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='ide0-0-0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </disk>
Aug 17 19:56:28 user nova-compute[72815]:     <controller type='usb' index='0' model='none'>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='usb'/>
Aug 17 19:56:28 user nova-compute[72815]:     </controller>
Aug 17 19:56:28 user nova-compute[72815]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='pci.0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </controller>
Aug 17 19:56:28 user nova-compute[72815]:     <controller type='ide' index='0'>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='ide'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 19:56:28 user nova-compute[72815]:     </controller>
Aug 17 19:56:28 user nova-compute[72815]:     <interface type='ethernet'>
Aug 17 19:56:28 user nova-compute[72815]:       <mac address='fa:16:3e:86:31:8b'/>
Aug 17 19:56:28 user nova-compute[72815]:       <target dev='tap011707bb-90'/>
Aug 17 19:56:28 user nova-compute[72815]:       <model type='virtio'/>
Aug 17 19:56:28 user nova-compute[72815]:       <mtu size='1442'/>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='net0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </interface>
Aug 17 19:56:28 user nova-compute[72815]:     <serial type='pty'>
Aug 17 19:56:28 user nova-compute[72815]:       <source path='/dev/pts/8'/>
Aug 17 19:56:28 user nova-compute[72815]:       <log file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/console.log' append='off'/>
Aug 17 19:56:28 user nova-compute[72815]:       <target type='isa-serial' port='0'>
Aug 17 19:56:28 user nova-compute[72815]:         <model name='isa-serial'/>
Aug 17 19:56:28 user nova-compute[72815]:       </target>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='serial0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </serial>
Aug 17 19:56:28 user nova-compute[72815]:     <console type='pty' tty='/dev/pts/8'>
Aug 17 19:56:28 user nova-compute[72815]:       <source path='/dev/pts/8'/>
Aug 17 19:56:28 user nova-compute[72815]:       <log file='/opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63/console.log' append='off'/>
Aug 17 19:56:28 user nova-compute[72815]:       <target type='serial' port='0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='serial0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </console>
Aug 17 19:56:28 user nova-compute[72815]:     <input type='mouse' bus='ps2'>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='input0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </input>
Aug 17 19:56:28 user nova-compute[72815]:     <input type='keyboard' bus='ps2'>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='input1'/>
Aug 17 19:56:28 user nova-compute[72815]:     </input>
Aug 17 19:56:28 user nova-compute[72815]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 17 19:56:28 user nova-compute[72815]:       <listen type='address' address='0.0.0.0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </graphics>
Aug 17 19:56:28 user nova-compute[72815]:     <audio id='1' type='none'/>
Aug 17 19:56:28 user nova-compute[72815]:     <video>
Aug 17 19:56:28 user nova-compute[72815]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='video0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </video>
Aug 17 19:56:28 user nova-compute[72815]:     <memballoon model='virtio'>
Aug 17 19:56:28 user nova-compute[72815]:       <stats period='10'/>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='balloon0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </memballoon>
Aug 17 19:56:28 user nova-compute[72815]:     <rng model='virtio'>
Aug 17 19:56:28 user nova-compute[72815]:       <backend model='random'>/dev/urandom</backend>
Aug 17 19:56:28 user nova-compute[72815]:       <alias name='rng0'/>
Aug 17 19:56:28 user nova-compute[72815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 19:56:28 user nova-compute[72815]:     </rng>
Aug 17 19:56:28 user nova-compute[72815]:   </devices>
Aug 17 19:56:28 user nova-compute[72815]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 19:56:28 user nova-compute[72815]:     <label>libvirt-07f12446-7bbc-4b95-a79b-99d48fa23d63</label>
Aug 17 19:56:28 user nova-compute[72815]:     <imagelabel>libvirt-07f12446-7bbc-4b95-a79b-99d48fa23d63</imagelabel>
Aug 17 19:56:28 user nova-compute[72815]:   </seclabel>
Aug 17 19:56:28 user nova-compute[72815]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 19:56:28 user nova-compute[72815]:     <label>+64055:+108</label>
Aug 17 19:56:28 user nova-compute[72815]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 19:56:28 user nova-compute[72815]:   </seclabel>
Aug 17 19:56:28 user nova-compute[72815]: </domain>
Aug 17 19:56:28 user nova-compute[72815]:  {{(pid=72815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 19:56:28 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Detaching interface fa:16:3e:27:4e:fb failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap1c8db3b8-c6' not found.
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13917815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13917815',id=9,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlbsB/SL5V5htublsblE53rgHUrd9eZYybyL04+s6cojpdS2pEXlZxF8DNM1ntLrIb/vWy80DhnU321He3lWo9jYEzzJlKGMilORzFpyhwZX5aQj4c3XPI1rKA578fn/A==',key_name='tempest-keypair-559643765',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:54:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8ba66c6a1bf494f867c7eec572d4880',ramdisk_id='',reservation_id='r-s5cxnqgd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-80529303',owner_user_name='tempest-TaggedAttachmentsTest-80529303-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a78dad1c02084db9b032efb86f7a503c',uuid=07f12446-7bbc-4b95-a79b-99d48fa23d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.network.os_vif_util [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] Converting VIF {"id": "1c8db3b8-c66d-4904-b304-7a60777894e2", "address": "fa:16:3e:27:4e:fb", "network": {"id": "377fc621-e91d-4e06-b7b0-875b12adc28e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1375705515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8db3b8-c6", "ovs_interfaceid": "1c8db3b8-c66d-4904-b304-7a60777894e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.network.os_vif_util [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=1c8db3b8-c66d-4904-b304-7a60777894e2,network=Network(377fc621-e91d-4e06-b7b0-875b12adc28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8db3b8-c6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG os_vif [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=1c8db3b8-c66d-4904-b304-7a60777894e2,network=Network(377fc621-e91d-4e06-b7b0-875b12adc28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8db3b8-c6') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c8db3b8-c6, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:28 user nova-compute[72815]: INFO os_vif [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=1c8db3b8-c66d-4904-b304-7a60777894e2,network=Network(377fc621-e91d-4e06-b7b0-875b12adc28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8db3b8-c6')
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [req-baf3dc1d-f1f9-40a4-afa9-043ea64b32b0 req-a2af032e-aef0-4354-b9cb-c3fb6df6646b service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:56:28 user nova-compute[72815]:   <nova:package version="0.0.0"/>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:name>tempest-device-tagging-server-13917815</nova:name>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:creationTime>2023-08-17 19:56:28</nova:creationTime>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:flavor name="m1.tiny">
Aug 17 19:56:28 user nova-compute[72815]:     <nova:memory>512</nova:memory>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:disk>1</nova:disk>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:swap>0</nova:swap>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:vcpus>1</nova:vcpus>
Aug 17 19:56:28 user nova-compute[72815]:   </nova:flavor>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:owner>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:user uuid="a78dad1c02084db9b032efb86f7a503c">tempest-TaggedAttachmentsTest-80529303-project-member</nova:user>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:project uuid="b8ba66c6a1bf494f867c7eec572d4880">tempest-TaggedAttachmentsTest-80529303</nova:project>
Aug 17 19:56:28 user nova-compute[72815]:   </nova:owner>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:56:28 user nova-compute[72815]:   <nova:ports>
Aug 17 19:56:28 user nova-compute[72815]:     <nova:port uuid="011707bb-905e-49f1-8517-e58e6907e383">
Aug 17 19:56:28 user nova-compute[72815]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 19:56:28 user nova-compute[72815]:     </nova:port>
Aug 17 19:56:28 user nova-compute[72815]:   </nova:ports>
Aug 17 19:56:28 user nova-compute[72815]: </nova:instance>
Aug 17 19:56:28 user nova-compute[72815]:  {{(pid=72815) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:56:28 user nova-compute[72815]: INFO nova.compute.claims [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Claim successful on node user
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-4cc8e1d0-f785-4c30-a67a-269d2eaf998d req-4efd969a-e66c-4134-af82-88110337ae88 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-vif-plugged-1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4cc8e1d0-f785-4c30-a67a-269d2eaf998d req-4efd969a-e66c-4134-af82-88110337ae88 service nova] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4cc8e1d0-f785-4c30-a67a-269d2eaf998d req-4efd969a-e66c-4134-af82-88110337ae88 service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4cc8e1d0-f785-4c30-a67a-269d2eaf998d req-4efd969a-e66c-4134-af82-88110337ae88 service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-4cc8e1d0-f785-4c30-a67a-269d2eaf998d req-4efd969a-e66c-4134-af82-88110337ae88 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] No waiting events found dispatching network-vif-plugged-1c8db3b8-c66d-4904-b304-7a60777894e2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:28 user nova-compute[72815]: WARNING nova.compute.manager [req-4cc8e1d0-f785-4c30-a67a-269d2eaf998d req-4efd969a-e66c-4134-af82-88110337ae88 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received unexpected event network-vif-plugged-1c8db3b8-c66d-4904-b304-7a60777894e2 for instance with vm_state active and task_state None.
Aug 17 19:56:28 user nova-compute[72815]: INFO nova.network.neutron [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Port 1c8db3b8-c66d-4904-b304-7a60777894e2 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 17 19:56:28 user nova-compute[72815]: DEBUG nova.network.neutron [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Updating instance_info_cache with network_info: [{"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Releasing lock "refresh_cache-07f12446-7bbc-4b95-a79b-99d48fa23d63" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8701c0ba-5e69-4715-8e80-9a147887950a tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "interface-07f12446-7bbc-4b95-a79b-99d48fa23d63-1c8db3b8-c66d-4904-b304-7a60777894e2" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.781s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:29 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:56:29 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7398MB free_disk=25.75069808959961GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.930s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.304s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302174.6612833, d00ba879-4c0f-4682-be36-8d61f44af9cf => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:56:29 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] VM Stopped (Lifecycle Event)
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-09f6bdfd-d914-48f2-83d8-e0cf468bc0f8 None None] [instance: d00ba879-4c0f-4682-be36-8d61f44af9cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.network.neutron [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:56:29 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 07d46763-1b59-4cce-9e10-e94d0efea05d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 969a1301-2014-4b22-8074-a0ac35136249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance e4a8f42b-da98-4652-be1f-393b790a87f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 07f12446-7bbc-4b95-a79b-99d48fa23d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 01fdb794-dc6b-412b-95e1-c6c80cb81ecf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 45b6365f-333f-45f1-b619-3453cbe75a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 541f3b1c-207c-4398-ad60-ea50e89d7327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:56:29 user nova-compute[72815]: DEBUG nova.policy [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '169121564e514d4f883b71abeb3e6070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c20bd5232b4b058abc1b50f38cade3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:56:29 user nova-compute[72815]: INFO nova.virt.block_device [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Booting with blank volume at /dev/vda
Aug 17 19:56:30 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:56:30 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:56:30 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:56:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:30 user nova-compute[72815]: DEBUG nova.network.neutron [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Successfully created port: 682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:56:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG nova.network.neutron [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Successfully updated port: 682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-019135fc-579b-4833-9e37-8b973f77b9a5 req-e3c43b38-01ef-4267-bea2-2cd029f310cd service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-changed-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-019135fc-579b-4833-9e37-8b973f77b9a5 req-e3c43b38-01ef-4267-bea2-2cd029f310cd service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Refreshing instance network info cache due to event network-changed-682cf83c-ed24-401a-bdd4-7375f529aacb. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-019135fc-579b-4833-9e37-8b973f77b9a5 req-e3c43b38-01ef-4267-bea2-2cd029f310cd service nova] Acquiring lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-019135fc-579b-4833-9e37-8b973f77b9a5 req-e3c43b38-01ef-4267-bea2-2cd029f310cd service nova] Acquired lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG nova.network.neutron [req-019135fc-579b-4833-9e37-8b973f77b9a5 req-e3c43b38-01ef-4267-bea2-2cd029f310cd service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Refreshing network info cache for port 682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG nova.network.neutron [req-019135fc-579b-4833-9e37-8b973f77b9a5 req-e3c43b38-01ef-4267-bea2-2cd029f310cd service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG nova.network.neutron [req-019135fc-579b-4833-9e37-8b973f77b9a5 req-e3c43b38-01ef-4267-bea2-2cd029f310cd service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-019135fc-579b-4833-9e37-8b973f77b9a5 req-e3c43b38-01ef-4267-bea2-2cd029f310cd service nova] Releasing lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquired lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG nova.network.neutron [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:56:31 user nova-compute[72815]: DEBUG nova.network.neutron [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:56:32 user nova-compute[72815]: DEBUG nova.network.neutron [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Updating instance_info_cache with network_info: [{"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Releasing lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Instance network_info: |[{"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG nova.compute.manager [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXoDIBUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01fdb794-dc6b-412b-95e1-c6c80cb81ecf', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7e0e313-4a7a-48cc-b1c1-40db20fc568e', 'serial': 'd7e0e313-4a7a-48cc-b1c1-40db20fc568e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JawgxXCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '01fdb794-dc6b-412b-95e1-c6c80cb81ecf', 'attached_at': '', 'detached_at': '', 'volume_id': '6999e88d-0317-40b2-aad1-8314e34739a3', 'serial'} {{(pid=72815) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXoDIBUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:34 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:34 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:34 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e74fbcd-46d3-482d-90fd-eb9491608aae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:56:34 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fa1a8c-d555-48dc-b568-aed2243fe2cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e] added
Aug 17 19:56:34 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec93917b-2e2c-4d9c-8799-c12e9926d30a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[718743a5-04ae-40e2-9a6a-a2e73b5de7cc]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXoDIBUF {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXoDIBUF" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ce57a4-23fc-491d-9c2f-1935dbe6d2a8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXoDIBUF'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f915584-2aa1-4061-94c5-8b696e098557]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff0d837-7b21-48b2-96c6-dec0784fcf86]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:34 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:34 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:34 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:34 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b215b74-0344-4697-ae15-80d774027e22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e, portal: 172.16.0.220,3260]
Aug 17 19:56:35 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[082860ac-a60e-4d8e-9842-92d19b77c4ea]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4290e08-a0ed-4cac-8f39-46732527b886]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:35 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:35 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:35 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:35 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] HCTL ('35', '-', '-', 0) found on session 9 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebbb6b3-753a-4aa7-ba85-2389405a690e]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Searching for a device in session 9 and hctl ['35', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:56:35 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Creating image(s)
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Ensure instance console log exists: /opt/stack/data/nova/instances/541f3b1c-207c-4398-ad60-ea50e89d7327/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Start _get_guest_xml network_info=[{"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': 'bf6e2b9c-e1ae-44a8-998b-16195efb0518', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQLHDUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '541f3b1c-207c-4398-ad60-ea50e89d7327', 'attached_at': '', 'detached_at': '', 'volume_id': '8cbb8fea-e52b-47ef-a807-da463a755e74', 'serial': '8cbb8fea-e52b-47ef-a807-da463a755e74'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:56:35 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:56:35 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQLHDUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:35 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.utils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9752f99-9bad-4599-a824-ee9c9bfd4622]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e997e3-59ab-493e-8488-d63e25ac554d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9aed60-6547-4888-85ad-937a824913be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1ecb09-5f98-4db0-b2de-8cd1c3e10ec7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:56:35 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:56:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab4c094-b39b-4f79-a976-6564e285ea02]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG os_brick.utils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:35 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Updating existing volume attachment record: 935728a7-77de-4f4d-9b8b-0086e8e1071e {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Searching for a device in session 9 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXoDIBUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26662666634396638', 'path': '/dev/sdd'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662666634396638', 'path': '/dev/sdd'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.501s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:36 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:36 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG nova.objects.instance [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lazy-loading 'flavor' on Instance uuid 01fdb794-dc6b-412b-95e1-c6c80cb81ecf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[273b6026-e48c-41c7-b460-3a3446beeaf2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:56:36 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3693ee19-63a0-4383-baa5-79610dbec4fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74] added
Aug 17 19:56:36 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b692a9-2242-49a8-ae38-eda53515c37c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaef33f-fa4b-4515-890d-c4099dbd4ac3]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qrQLHDUk {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qrQLHDUk" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb016b0-6d60-480a-ace0-21ef1e9c833d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qrQLHDUk'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b70d07d-fe2a-4494-a2d2-586fb598a5bc]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9169f0e6-5304-4630-9e96-c1fdd3315dc1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:36 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:36 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:36 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:36 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:36 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:36 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0494c78-3c0d-4120-8614-f487f30021ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260]
Aug 17 19:56:36 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:36 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[08433fa6-b0ad-4bb4-9931-e93d1fd92859]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[747e8cf2-28c5-4712-a66b-3f000f3ab7fe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:56:36 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:36 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:36 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:36 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:56:36 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:36 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:36 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:36 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7f0774-4aae-45b9-aa37-6d85cffd4824]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQLHDUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 87031808 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] <== connect_volume: return (1854ms) {'type': 'block', 'scsi_wwn': '23938393032383333', 'path': '/dev/sde'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938393032383333', 'path': '/dev/sde'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1165123793',display_name='tempest-TestShelveInstance-server-1165123793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1165123793',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOi2xPAwcqfdBW30FDVnS7XjBIbIL9ATRk8TVn3fOxiyLSk4/uTwVf9Ch/4yM8vaqqysPYH5jrDs4Bynmf17N9AcOBKLdweEqV6EFE5jypDJSnnZUP0g2Tlwbgatsxlpw==',key_name='tempest-TestShelveInstance-1359395454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e0a431d27ae4571bc0c8687e61c6fa2',ramdisk_id='',reservation_id='r-rvvq1591',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1622767385',owner_user_name='tempest-TestShelveInstance-1622767385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:56:24Z,user_data=None,user_id='ce9def2151a447a68337ee04072fb748',uuid=541f3b1c-207c-4398-ad60-ea50e89d7327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Converting VIF {"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.objects.instance [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lazy-loading 'pci_devices' on Instance uuid 541f3b1c-207c-4398-ad60-ea50e89d7327 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:56:37 user nova-compute[72815]:   <uuid>541f3b1c-207c-4398-ad60-ea50e89d7327</uuid>
Aug 17 19:56:37 user nova-compute[72815]:   <name>instance-0000000c</name>
Aug 17 19:56:37 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:56:37 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:56:37 user nova-compute[72815]:   <metadata>
Aug 17 19:56:37 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:56:37 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:56:37 user nova-compute[72815]:       <nova:name>tempest-TestShelveInstance-server-1165123793</nova:name>
Aug 17 19:56:37 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:56:35</nova:creationTime>
Aug 17 19:56:37 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:56:37 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:56:37 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:56:37 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:56:37 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:56:37 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:56:37 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:56:37 user nova-compute[72815]:       <nova:owner>
Aug 17 19:56:37 user nova-compute[72815]:         <nova:user uuid="ce9def2151a447a68337ee04072fb748">tempest-TestShelveInstance-1622767385-project-member</nova:user>
Aug 17 19:56:37 user nova-compute[72815]:         <nova:project uuid="0e0a431d27ae4571bc0c8687e61c6fa2">tempest-TestShelveInstance-1622767385</nova:project>
Aug 17 19:56:37 user nova-compute[72815]:       </nova:owner>
Aug 17 19:56:37 user nova-compute[72815]:       <nova:ports>
Aug 17 19:56:37 user nova-compute[72815]:         <nova:port uuid="9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e">
Aug 17 19:56:37 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 19:56:37 user nova-compute[72815]:         </nova:port>
Aug 17 19:56:37 user nova-compute[72815]:       </nova:ports>
Aug 17 19:56:37 user nova-compute[72815]:     </nova:instance>
Aug 17 19:56:37 user nova-compute[72815]:   </metadata>
Aug 17 19:56:37 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:56:37 user nova-compute[72815]:     <system>
Aug 17 19:56:37 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:56:37 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:56:37 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:56:37 user nova-compute[72815]:       <entry name="serial">541f3b1c-207c-4398-ad60-ea50e89d7327</entry>
Aug 17 19:56:37 user nova-compute[72815]:       <entry name="uuid">541f3b1c-207c-4398-ad60-ea50e89d7327</entry>
Aug 17 19:56:37 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:56:37 user nova-compute[72815]:     </system>
Aug 17 19:56:37 user nova-compute[72815]:   </sysinfo>
Aug 17 19:56:37 user nova-compute[72815]:   <os>
Aug 17 19:56:37 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:56:37 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:56:37 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:56:37 user nova-compute[72815]:   </os>
Aug 17 19:56:37 user nova-compute[72815]:   <features>
Aug 17 19:56:37 user nova-compute[72815]:     <acpi/>
Aug 17 19:56:37 user nova-compute[72815]:     <apic/>
Aug 17 19:56:37 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:56:37 user nova-compute[72815]:   </features>
Aug 17 19:56:37 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:56:37 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:56:37 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:56:37 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:56:37 user nova-compute[72815]:   </clock>
Aug 17 19:56:37 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:56:37 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:56:37 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:56:37 user nova-compute[72815]:   </cpu>
Aug 17 19:56:37 user nova-compute[72815]:   <devices>
Aug 17 19:56:37 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 19:56:37 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:37 user nova-compute[72815]:       <source dev="/dev/sde"/>
Aug 17 19:56:37 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:56:37 user nova-compute[72815]:       <serial>8cbb8fea-e52b-47ef-a807-da463a755e74</serial>
Aug 17 19:56:37 user nova-compute[72815]:     </disk>
Aug 17 19:56:37 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:56:37 user nova-compute[72815]:       <mac address="fa:16:3e:ef:8c:78"/>
Aug 17 19:56:37 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:56:37 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:56:37 user nova-compute[72815]:       <target dev="tap9dfd3fe6-63"/>
Aug 17 19:56:37 user nova-compute[72815]:     </interface>
Aug 17 19:56:37 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:56:37 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/541f3b1c-207c-4398-ad60-ea50e89d7327/console.log" append="off"/>
Aug 17 19:56:37 user nova-compute[72815]:     </serial>
Aug 17 19:56:37 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:56:37 user nova-compute[72815]:     <video>
Aug 17 19:56:37 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:56:37 user nova-compute[72815]:     </video>
Aug 17 19:56:37 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:56:37 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:56:37 user nova-compute[72815]:     </rng>
Aug 17 19:56:37 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:56:37 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:56:37 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:56:37 user nova-compute[72815]:     </memballoon>
Aug 17 19:56:37 user nova-compute[72815]:   </devices>
Aug 17 19:56:37 user nova-compute[72815]: </domain>
Aug 17 19:56:37 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1165123793',display_name='tempest-TestShelveInstance-server-1165123793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1165123793',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOi2xPAwcqfdBW30FDVnS7XjBIbIL9ATRk8TVn3fOxiyLSk4/uTwVf9Ch/4yM8vaqqysPYH5jrDs4Bynmf17N9AcOBKLdweEqV6EFE5jypDJSnnZUP0g2Tlwbgatsxlpw==',key_name='tempest-TestShelveInstance-1359395454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e0a431d27ae4571bc0c8687e61c6fa2',ramdisk_id='',reservation_id='r-rvvq1591',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1622767385',owner_user_name='tempest-TestShelveInstance-1622767385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:56:24Z,user_data=None,user_id='ce9def2151a447a68337ee04072fb748',uuid=541f3b1c-207c-4398-ad60-ea50e89d7327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Converting VIF {"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG os_vif [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dfd3fe6-63, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9dfd3fe6-63, col_values=(('external_ids', {'iface-id': '9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:8c:78', 'vm-uuid': '541f3b1c-207c-4398-ad60-ea50e89d7327'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 264241152 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:37 user nova-compute[72815]: INFO os_vif [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63')
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] No VIF found with MAC fa:16:3e:ef:8c:78, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:56:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 452984832 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:56:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 641728512 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:56:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 805306368 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:56:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 947912704 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:56:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-56ed4aaf-93b6-43d0-ba07-4bba7300e442 req-3b0899fb-86f4-4502-add3-8e8abce23864 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-56ed4aaf-93b6-43d0-ba07-4bba7300e442 req-3b0899fb-86f4-4502-add3-8e8abce23864 service nova] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-56ed4aaf-93b6-43d0-ba07-4bba7300e442 req-3b0899fb-86f4-4502-add3-8e8abce23864 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-56ed4aaf-93b6-43d0-ba07-4bba7300e442 req-3b0899fb-86f4-4502-add3-8e8abce23864 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-56ed4aaf-93b6-43d0-ba07-4bba7300e442 req-3b0899fb-86f4-4502-add3-8e8abce23864 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] No waiting events found dispatching network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:39 user nova-compute[72815]: WARNING nova.compute.manager [req-56ed4aaf-93b6-43d0-ba07-4bba7300e442 req-3b0899fb-86f4-4502-add3-8e8abce23864 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received unexpected event network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e for instance with vm_state building and task_state spawning.
Aug 17 19:56:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JawgxXCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:40 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[843bd58f-f8a5-4288-a105-87e85709221f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2b49fb-e1ce-48e4-8666-2da9dc7d530e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:56:40 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:40 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:40 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:56:40 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:40 user nova-compute[72815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:40 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399444cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3'): ({'sdc'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Removing single pathed devices sdc {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ce393e-4c64-4d7c-8f54-6b91b0303136]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5818b1a-5a98-47e9-80a0-e1299265d1b6]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Flushing IO for device /dev/sdc {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f92dd3a-d642-4dc5-a3f5-a1f35c47b50d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e62e6f-158b-4313-8d97-44fdf7cbf723]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0839dca1-5842-4f80-a57e-7a8cdf848d2b]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b66bb2-e1b7-4dd3-a8db-1cbde89b3a19]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260]
Aug 17 19:56:40 user nova-compute[72815]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea74bb0-1784-4fec-aa8b-94382f8ca3a7]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] <== disconnect_volume: return (345ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXoDIBUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '01fdb794-dc6b-412b-95e1-c6c80cb81ecf', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7e0e313-4a7a-48cc-b1c1-40db20fc568e', 'serial'} {{(pid=72815) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 19:56:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] swap_volume: removing Cinder connection for volume 6999e88d-0317-40b2-aad1-8314e34739a3 {{(pid=72815) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] swap_volume: Updating volume 6999e88d-0317-40b2-aad1-8314e34739a3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "nXoDIBUF", "auth_password": "CW8hZlFGRMw34q", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "d7e0e313-4a7a-48cc-b1c1-40db20fc568e"}, "status": "reserved", "instance": "01fdb794-dc6b-412b-95e1-c6c80cb81ecf", "attached_at": "", "detached_at": "", "volume_id": "d7e0e313-4a7a-48cc-b1c1-40db20fc568e", "serial": "d7e0e313-4a7a-48cc-b1c1-40db20fc568e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd7e0e313-4a7a-48cc-b1c1-40db20fc568e', 'no_device': None, 'attachment_id': 'b971d815-0201-417f-a58b-834f8a0f215f'} {{(pid=72815) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-53b2d1d0-3a72-438c-8ffa-0dc2d23b1edb tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.131s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302201.8888192, 541f3b1c-207c-4398-ad60-ea50e89d7327 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:56:41 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] VM Resumed (Lifecycle Event)
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:56:41 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Instance spawned successfully.
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-580878a9-ef9f-4e3f-b5d6-e6e7a25ae3af req-0bbb9663-6248-4798-b342-a87203830a98 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-580878a9-ef9f-4e3f-b5d6-e6e7a25ae3af req-0bbb9663-6248-4798-b342-a87203830a98 service nova] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-580878a9-ef9f-4e3f-b5d6-e6e7a25ae3af req-0bbb9663-6248-4798-b342-a87203830a98 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-580878a9-ef9f-4e3f-b5d6-e6e7a25ae3af req-0bbb9663-6248-4798-b342-a87203830a98 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-580878a9-ef9f-4e3f-b5d6-e6e7a25ae3af req-0bbb9663-6248-4798-b342-a87203830a98 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] No waiting events found dispatching network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:41 user nova-compute[72815]: WARNING nova.compute.manager [req-580878a9-ef9f-4e3f-b5d6-e6e7a25ae3af req-0bbb9663-6248-4798-b342-a87203830a98 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received unexpected event network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e for instance with vm_state building and task_state spawning.
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:41 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302201.8904545, 541f3b1c-207c-4398-ad60-ea50e89d7327 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:56:41 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] VM Started (Lifecycle Event)
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:56:42 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:56:42 user nova-compute[72815]: INFO nova.compute.manager [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 17 19:56:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:42 user nova-compute[72815]: INFO nova.compute.manager [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Took 18.72 seconds to build instance.
Aug 17 19:56:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-444ca58c-8440-41e2-96cb-97bcb685afb7 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.828s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Acquiring lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:42 user nova-compute[72815]: DEBUG os_brick.utils [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe2b622-ea64-4a23-82a2-b263c50926f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e86bd8-879b-4158-81af-620e4e2de6e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e8d769-85fe-46ff-b4aa-8df52f577bbf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab06221c-e27a-42cd-b256-ede2415da3ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:56:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:56:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:56:43 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:56:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3aa226-e31a-4df5-b9f3-70bfb49c3cf4]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:56:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:56:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:56:43 user nova-compute[72815]: DEBUG os_brick.utils [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:43 user nova-compute[72815]: INFO nova.compute.manager [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Swapping volume d7e0e313-4a7a-48cc-b1c1-40db20fc568e for 6999e88d-0317-40b2-aad1-8314e34739a3
Aug 17 19:56:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:56:49 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Creating image(s)
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Ensure instance console log exists: /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Start _get_guest_xml network_info=[{"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '935728a7-77de-4f4d-9b8b-0086e8e1071e', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVceLKTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ac6faff5-9700-4504-81d8-8ba2ab64d85f', 'attached_at': '', 'detached_at': '', 'volume_id': '6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e', 'serial': '6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:56:49 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:56:49 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVceLKTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:49 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:49 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:49 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbc467e-d2c0-40d2-947f-be9a8e93854a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:56:49 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2ab7dc-eca6-47a9-9609-d5b01a68d6c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e] added
Aug 17 19:56:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb5fd0b-f546-4da3-8a1a-2eedb343a573]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4670d0-6ca8-4666-968f-168fbdefff11]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVceLKTw {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVceLKTw" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[037879f3-3b62-4911-8e5e-44a12eeb12b6]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iVceLKTw'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0940c0e8-e002-4fbd-8760-781ac3326c0c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35299f1-aa85-4b18-83c7-b564113598fb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:56:49 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:49 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:56:49 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:49 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeb4260-83fe-41f5-99da-6c17f2ade3a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e, portal: 172.16.0.220,3260]
Aug 17 19:56:49 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b90600-feb2-4155-a0f8-33c0bc146502]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5d5370-6d2f-4e75-863f-52de75e92578]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:56:49 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:56:49 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:49 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:56:49 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:56:49 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:49 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a36e1c1-f058-45a8-9874-278dac5c514e]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:56:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVceLKTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26132653465326333', 'path': '/dev/sdc'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132653465326333', 'path': '/dev/sdc'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-686218442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-686218442',id=13,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-h68ujh5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:56:30Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=ac6faff5-9700-4504-81d8-8ba2ab64d85f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ba:21,bridge_name='br-int',has_traffic_filtering=True,id=682cf83c-ed24-401a-bdd4-7375f529aacb,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682cf83c-ed') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG nova.objects.instance [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'pci_devices' on Instance uuid ac6faff5-9700-4504-81d8-8ba2ab64d85f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:56:50 user nova-compute[72815]:   <uuid>ac6faff5-9700-4504-81d8-8ba2ab64d85f</uuid>
Aug 17 19:56:50 user nova-compute[72815]:   <name>instance-0000000d</name>
Aug 17 19:56:50 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:56:50 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:56:50 user nova-compute[72815]:   <metadata>
Aug 17 19:56:50 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:56:50 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:56:50 user nova-compute[72815]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-686218442</nova:name>
Aug 17 19:56:50 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:56:49</nova:creationTime>
Aug 17 19:56:50 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:56:50 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:56:50 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:56:50 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:56:50 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:56:50 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:56:50 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:56:50 user nova-compute[72815]:       <nova:owner>
Aug 17 19:56:50 user nova-compute[72815]:         <nova:user uuid="169121564e514d4f883b71abeb3e6070">tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member</nova:user>
Aug 17 19:56:50 user nova-compute[72815]:         <nova:project uuid="89c20bd5232b4b058abc1b50f38cade3">tempest-ServerBootFromVolumeStableRescueTest-264619992</nova:project>
Aug 17 19:56:50 user nova-compute[72815]:       </nova:owner>
Aug 17 19:56:50 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:56:50 user nova-compute[72815]:       <nova:ports>
Aug 17 19:56:50 user nova-compute[72815]:         <nova:port uuid="682cf83c-ed24-401a-bdd4-7375f529aacb">
Aug 17 19:56:50 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 19:56:50 user nova-compute[72815]:         </nova:port>
Aug 17 19:56:50 user nova-compute[72815]:       </nova:ports>
Aug 17 19:56:50 user nova-compute[72815]:     </nova:instance>
Aug 17 19:56:50 user nova-compute[72815]:   </metadata>
Aug 17 19:56:50 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:56:50 user nova-compute[72815]:     <system>
Aug 17 19:56:50 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:56:50 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:56:50 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:56:50 user nova-compute[72815]:       <entry name="serial">ac6faff5-9700-4504-81d8-8ba2ab64d85f</entry>
Aug 17 19:56:50 user nova-compute[72815]:       <entry name="uuid">ac6faff5-9700-4504-81d8-8ba2ab64d85f</entry>
Aug 17 19:56:50 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:56:50 user nova-compute[72815]:     </system>
Aug 17 19:56:50 user nova-compute[72815]:   </sysinfo>
Aug 17 19:56:50 user nova-compute[72815]:   <os>
Aug 17 19:56:50 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:56:50 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:56:50 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:56:50 user nova-compute[72815]:   </os>
Aug 17 19:56:50 user nova-compute[72815]:   <features>
Aug 17 19:56:50 user nova-compute[72815]:     <acpi/>
Aug 17 19:56:50 user nova-compute[72815]:     <apic/>
Aug 17 19:56:50 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:56:50 user nova-compute[72815]:   </features>
Aug 17 19:56:50 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:56:50 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:56:50 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:56:50 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:56:50 user nova-compute[72815]:   </clock>
Aug 17 19:56:50 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:56:50 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:56:50 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:56:50 user nova-compute[72815]:   </cpu>
Aug 17 19:56:50 user nova-compute[72815]:   <devices>
Aug 17 19:56:50 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 19:56:50 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:56:50 user nova-compute[72815]:       <source dev="/dev/sdc"/>
Aug 17 19:56:50 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:56:50 user nova-compute[72815]:       <serial>6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e</serial>
Aug 17 19:56:50 user nova-compute[72815]:     </disk>
Aug 17 19:56:50 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:56:50 user nova-compute[72815]:       <mac address="fa:16:3e:0d:ba:21"/>
Aug 17 19:56:50 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:56:50 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:56:50 user nova-compute[72815]:       <target dev="tap682cf83c-ed"/>
Aug 17 19:56:50 user nova-compute[72815]:     </interface>
Aug 17 19:56:50 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:56:50 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/console.log" append="off"/>
Aug 17 19:56:50 user nova-compute[72815]:     </serial>
Aug 17 19:56:50 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:56:50 user nova-compute[72815]:     <video>
Aug 17 19:56:50 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:56:50 user nova-compute[72815]:     </video>
Aug 17 19:56:50 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:56:50 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:56:50 user nova-compute[72815]:     </rng>
Aug 17 19:56:50 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:56:50 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:56:50 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:56:50 user nova-compute[72815]:     </memballoon>
Aug 17 19:56:50 user nova-compute[72815]:   </devices>
Aug 17 19:56:50 user nova-compute[72815]: </domain>
Aug 17 19:56:50 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-686218442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-686218442',id=13,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-h68ujh5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:56:30Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=ac6faff5-9700-4504-81d8-8ba2ab64d85f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ba:21,bridge_name='br-int',has_traffic_filtering=True,id=682cf83c-ed24-401a-bdd4-7375f529aacb,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682cf83c-ed') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG os_vif [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ba:21,bridge_name='br-int',has_traffic_filtering=True,id=682cf83c-ed24-401a-bdd4-7375f529aacb,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682cf83c-ed') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap682cf83c-ed, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap682cf83c-ed, col_values=(('external_ids', {'iface-id': '682cf83c-ed24-401a-bdd4-7375f529aacb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:ba:21', 'vm-uuid': 'ac6faff5-9700-4504-81d8-8ba2ab64d85f'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:50 user nova-compute[72815]: INFO os_vif [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ba:21,bridge_name='br-int',has_traffic_filtering=True,id=682cf83c-ed24-401a-bdd4-7375f529aacb,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682cf83c-ed')
Aug 17 19:56:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No VIF found with MAC fa:16:3e:0d:ba:21, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:56:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:56:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:51 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:56:51 user nova-compute[72815]: INFO nova.compute.claims [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Claim successful on node user
Aug 17 19:56:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-63189f12-971f-444d-9b3e-338e0cafb852 req-01a4d0c5-32b8-4aab-ae34-981a1b935a91 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-63189f12-971f-444d-9b3e-338e0cafb852 req-01a4d0c5-32b8-4aab-ae34-981a1b935a91 service nova] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-63189f12-971f-444d-9b3e-338e0cafb852 req-01a4d0c5-32b8-4aab-ae34-981a1b935a91 service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-63189f12-971f-444d-9b3e-338e0cafb852 req-01a4d0c5-32b8-4aab-ae34-981a1b935a91 service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-63189f12-971f-444d-9b3e-338e0cafb852 req-01a4d0c5-32b8-4aab-ae34-981a1b935a91 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] No waiting events found dispatching network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:52 user nova-compute[72815]: WARNING nova.compute.manager [req-63189f12-971f-444d-9b3e-338e0cafb852 req-01a4d0c5-32b8-4aab-ae34-981a1b935a91 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received unexpected event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb for instance with vm_state building and task_state spawning.
Aug 17 19:56:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:56:52 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:56:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG nova.policy [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03912162ae0f4b299c8c7b044b61798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0bfaa4f27c4bf1bf6be9b74b9f8a09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:56:52 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Creating image(s)
Aug 17 19:56:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "/opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "/opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.197s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk 1073741824" returned: 0 in 0.055s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Successfully created port: e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.214s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Cannot resize image /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG nova.objects.instance [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'migration_context' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Ensure instance console log exists: /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302214.210015, ac6faff5-9700-4504-81d8-8ba2ab64d85f => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:56:54 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] VM Resumed (Lifecycle Event)
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:56:54 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Instance spawned successfully.
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:54 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302214.2197752, ac6faff5-9700-4504-81d8-8ba2ab64d85f => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:56:54 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] VM Started (Lifecycle Event)
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-19026c7e-914c-4d7e-85a2-ce8fc5cdf76d req-161d4553-11f0-4f96-90de-1fe2291be66d service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-19026c7e-914c-4d7e-85a2-ce8fc5cdf76d req-161d4553-11f0-4f96-90de-1fe2291be66d service nova] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-19026c7e-914c-4d7e-85a2-ce8fc5cdf76d req-161d4553-11f0-4f96-90de-1fe2291be66d service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-19026c7e-914c-4d7e-85a2-ce8fc5cdf76d req-161d4553-11f0-4f96-90de-1fe2291be66d service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-19026c7e-914c-4d7e-85a2-ce8fc5cdf76d req-161d4553-11f0-4f96-90de-1fe2291be66d service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] No waiting events found dispatching network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:54 user nova-compute[72815]: WARNING nova.compute.manager [req-19026c7e-914c-4d7e-85a2-ce8fc5cdf76d req-161d4553-11f0-4f96-90de-1fe2291be66d service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received unexpected event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb for instance with vm_state building and task_state spawning.
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:56:54 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:56:54 user nova-compute[72815]: INFO nova.compute.manager [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Took 5.32 seconds to spawn the instance on the hypervisor.
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:54 user nova-compute[72815]: INFO nova.compute.manager [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Took 25.79 seconds to build instance.
Aug 17 19:56:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-09cc776c-6767-4d47-a3ba-865bd7a7087d tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.942s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Successfully updated port: e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquired lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-48157ecf-1541-456d-b6d4-f1357212dc2f req-c55d4e01-a610-45c6-884e-1e972c5a26e3 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-changed-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-48157ecf-1541-456d-b6d4-f1357212dc2f req-c55d4e01-a610-45c6-884e-1e972c5a26e3 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Refreshing instance network info cache due to event network-changed-e936e6d3-48e1-4322-b2d4-779037eff32c. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-48157ecf-1541-456d-b6d4-f1357212dc2f req-c55d4e01-a610-45c6-884e-1e972c5a26e3 service nova] Acquiring lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating instance_info_cache with network_info: [{"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Releasing lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Instance network_info: |[{"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-48157ecf-1541-456d-b6d4-f1357212dc2f req-c55d4e01-a610-45c6-884e-1e972c5a26e3 service nova] Acquired lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.network.neutron [req-48157ecf-1541-456d-b6d4-f1357212dc2f req-c55d4e01-a610-45c6-884e-1e972c5a26e3 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Refreshing network info cache for port e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:56:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Start _get_guest_xml network_info=[{"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:56:54 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:56:54 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-468217050',display_name='tempest-ServerActionsTestOtherB-server-468217050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-468217050',id=14,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpS9twCAKB9Qcxa77kKBv1mcMWNNwvJ8PtuQNagNxi+2wHS7dCki+1ibMc73BH5JCIYY5sRP3ThGzFZPpzGom37joOakxOGFFMKzFdXVL+/I3uzE68ATLp8T4Wn8HgTCg==',key_name='tempest-keypair-1805104337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f0bfaa4f27c4bf1bf6be9b74b9f8a09',ramdisk_id='',reservation_id='r-8y7ruqfi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-166537402',owner_user_name='tempest-ServerActionsTestOtherB-166537402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:56:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03912162ae0f4b299c8c7b044b61798f',uuid=3a4f27f3-4573-43b5-827a-bbdae4ebce10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converting VIF {"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.objects.instance [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:56:55 user nova-compute[72815]:   <uuid>3a4f27f3-4573-43b5-827a-bbdae4ebce10</uuid>
Aug 17 19:56:55 user nova-compute[72815]:   <name>instance-0000000e</name>
Aug 17 19:56:55 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:56:55 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:56:55 user nova-compute[72815]:   <metadata>
Aug 17 19:56:55 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:56:55 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:56:55 user nova-compute[72815]:       <nova:name>tempest-ServerActionsTestOtherB-server-468217050</nova:name>
Aug 17 19:56:55 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:56:54</nova:creationTime>
Aug 17 19:56:55 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:56:55 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:56:55 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:56:55 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:56:55 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:56:55 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:56:55 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:56:55 user nova-compute[72815]:       <nova:owner>
Aug 17 19:56:55 user nova-compute[72815]:         <nova:user uuid="03912162ae0f4b299c8c7b044b61798f">tempest-ServerActionsTestOtherB-166537402-project-member</nova:user>
Aug 17 19:56:55 user nova-compute[72815]:         <nova:project uuid="6f0bfaa4f27c4bf1bf6be9b74b9f8a09">tempest-ServerActionsTestOtherB-166537402</nova:project>
Aug 17 19:56:55 user nova-compute[72815]:       </nova:owner>
Aug 17 19:56:55 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:56:55 user nova-compute[72815]:       <nova:ports>
Aug 17 19:56:55 user nova-compute[72815]:         <nova:port uuid="e936e6d3-48e1-4322-b2d4-779037eff32c">
Aug 17 19:56:55 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 19:56:55 user nova-compute[72815]:         </nova:port>
Aug 17 19:56:55 user nova-compute[72815]:       </nova:ports>
Aug 17 19:56:55 user nova-compute[72815]:     </nova:instance>
Aug 17 19:56:55 user nova-compute[72815]:   </metadata>
Aug 17 19:56:55 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:56:55 user nova-compute[72815]:     <system>
Aug 17 19:56:55 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:56:55 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:56:55 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:56:55 user nova-compute[72815]:       <entry name="serial">3a4f27f3-4573-43b5-827a-bbdae4ebce10</entry>
Aug 17 19:56:55 user nova-compute[72815]:       <entry name="uuid">3a4f27f3-4573-43b5-827a-bbdae4ebce10</entry>
Aug 17 19:56:55 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:56:55 user nova-compute[72815]:     </system>
Aug 17 19:56:55 user nova-compute[72815]:   </sysinfo>
Aug 17 19:56:55 user nova-compute[72815]:   <os>
Aug 17 19:56:55 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:56:55 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:56:55 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:56:55 user nova-compute[72815]:   </os>
Aug 17 19:56:55 user nova-compute[72815]:   <features>
Aug 17 19:56:55 user nova-compute[72815]:     <acpi/>
Aug 17 19:56:55 user nova-compute[72815]:     <apic/>
Aug 17 19:56:55 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:56:55 user nova-compute[72815]:   </features>
Aug 17 19:56:55 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:56:55 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:56:55 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:56:55 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:56:55 user nova-compute[72815]:   </clock>
Aug 17 19:56:55 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:56:55 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:56:55 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:56:55 user nova-compute[72815]:   </cpu>
Aug 17 19:56:55 user nova-compute[72815]:   <devices>
Aug 17 19:56:55 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:56:55 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:56:55 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk"/>
Aug 17 19:56:55 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:56:55 user nova-compute[72815]:     </disk>
Aug 17 19:56:55 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:56:55 user nova-compute[72815]:       <mac address="fa:16:3e:7f:6e:78"/>
Aug 17 19:56:55 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:56:55 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:56:55 user nova-compute[72815]:       <target dev="tape936e6d3-48"/>
Aug 17 19:56:55 user nova-compute[72815]:     </interface>
Aug 17 19:56:55 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:56:55 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/console.log" append="off"/>
Aug 17 19:56:55 user nova-compute[72815]:     </serial>
Aug 17 19:56:55 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:56:55 user nova-compute[72815]:     <video>
Aug 17 19:56:55 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:56:55 user nova-compute[72815]:     </video>
Aug 17 19:56:55 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:56:55 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:56:55 user nova-compute[72815]:     </rng>
Aug 17 19:56:55 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:56:55 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:56:55 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:56:55 user nova-compute[72815]:     </memballoon>
Aug 17 19:56:55 user nova-compute[72815]:   </devices>
Aug 17 19:56:55 user nova-compute[72815]: </domain>
Aug 17 19:56:55 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-468217050',display_name='tempest-ServerActionsTestOtherB-server-468217050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-468217050',id=14,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpS9twCAKB9Qcxa77kKBv1mcMWNNwvJ8PtuQNagNxi+2wHS7dCki+1ibMc73BH5JCIYY5sRP3ThGzFZPpzGom37joOakxOGFFMKzFdXVL+/I3uzE68ATLp8T4Wn8HgTCg==',key_name='tempest-keypair-1805104337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f0bfaa4f27c4bf1bf6be9b74b9f8a09',ramdisk_id='',reservation_id='r-8y7ruqfi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-166537402',owner_user_name='tempest-ServerActionsTestOtherB-166537402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:56:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03912162ae0f4b299c8c7b044b61798f',uuid=3a4f27f3-4573-43b5-827a-bbdae4ebce10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converting VIF {"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG os_vif [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape936e6d3-48, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape936e6d3-48, col_values=(('external_ids', {'iface-id': 'e936e6d3-48e1-4322-b2d4-779037eff32c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:6e:78', 'vm-uuid': '3a4f27f3-4573-43b5-827a-bbdae4ebce10'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:55 user nova-compute[72815]: INFO os_vif [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48')
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] No VIF found with MAC fa:16:3e:7f:6e:78, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.network.neutron [req-48157ecf-1541-456d-b6d4-f1357212dc2f req-c55d4e01-a610-45c6-884e-1e972c5a26e3 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updated VIF entry in instance network info cache for port e936e6d3-48e1-4322-b2d4-779037eff32c. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.network.neutron [req-48157ecf-1541-456d-b6d4-f1357212dc2f req-c55d4e01-a610-45c6-884e-1e972c5a26e3 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating instance_info_cache with network_info: [{"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-48157ecf-1541-456d-b6d4-f1357212dc2f req-c55d4e01-a610-45c6-884e-1e972c5a26e3 service nova] Releasing lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JawgxXCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01fdb794-dc6b-412b-95e1-c6c80cb81ecf', 'attached_at': '', 'detached_at': '', 'volume_id': '6999e88d-0317-40b2-aad1-8314e34739a3', 'serial': '6999e88d-0317-40b2-aad1-8314e34739a3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXoDIBUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'd7e0e313-4a7a-48cc-b1c1-40db20fc568e'}, 'status': 'reserved', 'instance': '01fdb794-dc6b-412b-95e1-c6c80cb81ecf', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7e0e313-4a7a-48cc-b1c1-40db20fc568e', 'serial'} {{(pid=72815) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JawgxXCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:56:55 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:55 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:56:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:56:55 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:56:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ae153e-127e-4460-8a6c-5f68c18688b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:56:55 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4566f9c1-2646-494f-a2ef-8726fdf028bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3] added
Aug 17 19:56:55 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8bee47-9002-4bc0-8540-ce5ad25eb715]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[01665fe2-77d6-44be-b657-927cfb6508cf]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JawgxXCq {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JawgxXCq" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b322143e-168b-4711-9670-e6713ae9213e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JawgxXCq'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf5962e-46ec-4b3e-b2e0-c5f58a54d611]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f711bf-bd8a-4093-9029-371f0dee2b2e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:56:56 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:56:56 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:56 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:56:56 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:56:56 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:56 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-187abd28-e62f-4340-ac5a-1e5abb1289e3 req-3d24e604-2a66-4ca5-85c7-f3615707d109 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-187abd28-e62f-4340-ac5a-1e5abb1289e3 req-3d24e604-2a66-4ca5-85c7-f3615707d109 service nova] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-187abd28-e62f-4340-ac5a-1e5abb1289e3 req-3d24e604-2a66-4ca5-85c7-f3615707d109 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-187abd28-e62f-4340-ac5a-1e5abb1289e3 req-3d24e604-2a66-4ca5-85c7-f3615707d109 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-187abd28-e62f-4340-ac5a-1e5abb1289e3 req-3d24e604-2a66-4ca5-85c7-f3615707d109 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] No waiting events found dispatching network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:56 user nova-compute[72815]: WARNING nova.compute.manager [req-187abd28-e62f-4340-ac5a-1e5abb1289e3 req-3d24e604-2a66-4ca5-85c7-f3615707d109 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received unexpected event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c for instance with vm_state building and task_state spawning.
Aug 17 19:56:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --login" returned: 0 in 1.072s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a333530f-409c-4cc3-9c2b-483a636e0165]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260]
Aug 17 19:56:57 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260] successful.
Aug 17 19:56:57 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92573e3-3306-4987-a702-f56f3d172c09]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4f942b-9969-48d0-bc4f-c26f89d54a2d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:56:57 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:56:57 user nova-compute[72815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:57 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:57 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:57 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:56:57 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:56:57 user nova-compute[72815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:56:57 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:56:57 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:56:57 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.317s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13d9a00-94ae-4879-881e-abc6ef373ca7]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JawgxXCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:56:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.355s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:56:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] <== connect_volume: return (2357ms) {'type': 'block', 'scsi_wwn': '23166636263656263', 'path': '/dev/sdf'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:56:58 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166636263656263', 'path': '/dev/sdf'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:56:58 user nova-compute[72815]: DEBUG nova.objects.instance [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lazy-loading 'flavor' on Instance uuid 01fdb794-dc6b-412b-95e1-c6c80cb81ecf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:56:58 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302219.0015268, 3a4f27f3-4573-43b5-827a-bbdae4ebce10 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:56:59 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] VM Resumed (Lifecycle Event)
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.compute.manager [req-54797ff4-6a65-47e9-a604-dc439ac0424f req-9dda11c8-9236-4951-8e89-042ee4adcd6d service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54797ff4-6a65-47e9-a604-dc439ac0424f req-9dda11c8-9236-4951-8e89-042ee4adcd6d service nova] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54797ff4-6a65-47e9-a604-dc439ac0424f req-9dda11c8-9236-4951-8e89-042ee4adcd6d service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54797ff4-6a65-47e9-a604-dc439ac0424f req-9dda11c8-9236-4951-8e89-042ee4adcd6d service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.compute.manager [req-54797ff4-6a65-47e9-a604-dc439ac0424f req-9dda11c8-9236-4951-8e89-042ee4adcd6d service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] No waiting events found dispatching network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:56:59 user nova-compute[72815]: WARNING nova.compute.manager [req-54797ff4-6a65-47e9-a604-dc439ac0424f req-9dda11c8-9236-4951-8e89-042ee4adcd6d service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received unexpected event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c for instance with vm_state building and task_state spawning.
Aug 17 19:56:59 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Instance spawned successfully.
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:56:59 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302219.0062785, 3a4f27f3-4573-43b5-827a-bbdae4ebce10 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:56:59 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] VM Started (Lifecycle Event)
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:56:59 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:56:59 user nova-compute[72815]: INFO nova.compute.manager [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:56:59 user nova-compute[72815]: INFO nova.compute.manager [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Took 7.35 seconds to build instance.
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 112197632 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d5667d39-cbc7-4ff4-a4c0-24a184940d08 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.459s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:56:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 291504128 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:57:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 444596224 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:57:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 600834048 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:57:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 758120448 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:57:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 890241024 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXoDIBUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'd7e0e313-4a7a-48cc-b1c1-40db20fc568e'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:57:02 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2b65d3-b56d-4144-ae45-38410094c67a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ece62b-7f72-4ef7-bdaa-4da7c83ed2ed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:02 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:02 user nova-compute[72815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:57:02 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:02 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:57:02 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:02 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:02 user nova-compute[72815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:57:02 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:02 user nova-compute[72815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e (non-flash)
Aug 17 19:57:02 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994475000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e'): ({'sdd'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Removing single pathed devices sdd {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffd2b9a-0bc6-4819-aba1-f1aa12c0fd1a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd812e81-0e7e-4c72-833a-9a422a7a22eb]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Flushing IO for device /dev/sdd {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c821ed40-52b8-4fd2-998f-3eae7f3812e3]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5710fd-eca8-40f9-a8eb-d569e823eaa0]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb26ce09-70c6-4e39-8820-27be089835d6]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8288ffe6-0233-4b5e-b948-844aee736289]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e, portal: 172.16.0.220,3260]
Aug 17 19:57:02 user nova-compute[72815]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e, portal: 172.16.0.220,3260] successful.
Aug 17 19:57:02 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e0e313-4a7a-48cc-b1c1-40db20fc568e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[710045c5-fb9c-4eec-832c-38e0e7817a37]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] <== disconnect_volume: return (319ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JawgxXCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '01fdb794-dc6b-412b-95e1-c6c80cb81ecf', 'attached_at': '', 'detached_at': '', 'volume_id': '6999e88d-0317-40b2-aad1-8314e34739a3', 'serial'} {{(pid=72815) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 19:57:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] swap_volume: removing Cinder connection for volume d7e0e313-4a7a-48cc-b1c1-40db20fc568e {{(pid=72815) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 19:57:03 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] swap_volume: Updating volume d7e0e313-4a7a-48cc-b1c1-40db20fc568e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "JawgxXCq", "auth_password": "x6dbHJPlOhXsqw", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "6999e88d-0317-40b2-aad1-8314e34739a3"}, "status": "reserved", "instance": "01fdb794-dc6b-412b-95e1-c6c80cb81ecf", "attached_at": "", "detached_at": "", "volume_id": "6999e88d-0317-40b2-aad1-8314e34739a3", "serial": "6999e88d-0317-40b2-aad1-8314e34739a3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6999e88d-0317-40b2-aad1-8314e34739a3', 'no_device': None, 'attachment_id': '8722ccc6-1907-4595-9458-dfe0a284383a'} {{(pid=72815) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 19:57:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d824e781-c254-472d-b1de-895e5d8e12f3 tempest-TestVolumeSwap-296199135 tempest-TestVolumeSwap-296199135-project-admin] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.980s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "82e60703-5060-446c-83c3-3b1c4c52abab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "82e60703-5060-446c-83c3-3b1c4c52abab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:57:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:57:04 user nova-compute[72815]: INFO nova.compute.claims [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Claim successful on node user
Aug 17 19:57:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:05 user nova-compute[72815]: INFO nova.compute.manager [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Detaching volume 6999e88d-0317-40b2-aad1-8314e34739a3
Aug 17 19:57:05 user nova-compute[72815]: INFO nova.virt.block_device [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Attempting to driver detach volume 6999e88d-0317-40b2-aad1-8314e34739a3 from mountpoint /dev/vdb
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Attempting to detach device vdb from instance 01fdb794-dc6b-412b-95e1-c6c80cb81ecf from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:57:05 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:57:05 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 19:57:05 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:57:05 user nova-compute[72815]:   <serial>6999e88d-0317-40b2-aad1-8314e34739a3</serial>
Aug 17 19:57:05 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:57:05 user nova-compute[72815]: </disk>
Aug 17 19:57:05 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:57:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Successfully detached device vdb from instance 01fdb794-dc6b-412b-95e1-c6c80cb81ecf from the persistent domain config.
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01fdb794-dc6b-412b-95e1-c6c80cb81ecf from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:57:05 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:57:05 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 19:57:05 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:57:05 user nova-compute[72815]:   <serial>6999e88d-0317-40b2-aad1-8314e34739a3</serial>
Aug 17 19:57:05 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:57:05 user nova-compute[72815]: </disk>
Aug 17 19:57:05 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.690s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.network.neutron [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:57:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:57:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.policy [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f92e9d1656b4677bc1539c279e60450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f619f5dec7704081974d9a757c392090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302225.7227283, 01fdb794-dc6b-412b-95e1-c6c80cb81ecf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01fdb794-dc6b-412b-95e1-c6c80cb81ecf {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 19:57:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Successfully detached device vdb from instance 01fdb794-dc6b-412b-95e1-c6c80cb81ecf from the live domain config.
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JawgxXCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '6999e88d-0317-40b2-aad1-8314e34739a3'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:57:05 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:57:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Creating image(s)
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "/opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "/opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "/opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaae7807-b25f-4cc1-a430-a2ae1fdc3d9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a108276-14d2-4fdd-a503-1caffdeaccb8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:05 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:05 user nova-compute[72815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:57:05 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:05 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:05 user nova-compute[72815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 (non-flash)
Aug 17 19:57:05 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39947427a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3'): ({'sdf'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Removing single pathed devices sdf {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1937356-66a4-441c-835f-d6d07ad00e10]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[312250fa-1966-41a5-8d66-4a63aba965c8]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Flushing IO for device /dev/sdf {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7297f31-7e9b-4dbe-9673-59022d5daa03]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35bb71b-87ac-45bb-b6aa-097f38a3f658]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.175s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d930fd-aa51-4d4a-91cf-10bdcf4367c8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad42a750-4bd3-49ff-9733-b3af106cfddf]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260]
Aug 17 19:57:06 user nova-compute[72815]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3, portal: 172.16.0.220,3260] successful.
Aug 17 19:57:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e88d-0317-40b2-aad1-8314e34739a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[53798601-8bbd-4d74-91fb-9748a149e21b]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] <== disconnect_volume: return (353ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.210s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk 1073741824" returned: 0 in 0.052s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG nova.network.neutron [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Successfully created port: cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.189s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Cannot resize image /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG nova.objects.instance [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lazy-loading 'migration_context' on Instance uuid 82e60703-5060-446c-83c3-3b1c4c52abab {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Ensure instance console log exists: /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:06 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lazy-loading 'flavor' on Instance uuid 01fdb794-dc6b-412b-95e1-c6c80cb81ecf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f5cd2f89-641b-4a54-a020-79230e3b6e56 tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.945s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Successfully updated port: cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "refresh_cache-82e60703-5060-446c-83c3-3b1c4c52abab" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquired lock "refresh_cache-82e60703-5060-446c-83c3-3b1c4c52abab" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-31038041-e249-40b5-b54f-3486db83f48b req-1e4c3219-2bfc-4af2-8273-ccfc4f10460e service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Received event network-changed-cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-31038041-e249-40b5-b54f-3486db83f48b req-1e4c3219-2bfc-4af2-8273-ccfc4f10460e service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Refreshing instance network info cache due to event network-changed-cd78781d-eff7-4100-8263-6717c622c4e4. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-31038041-e249-40b5-b54f-3486db83f48b req-1e4c3219-2bfc-4af2-8273-ccfc4f10460e service nova] Acquiring lock "refresh_cache-82e60703-5060-446c-83c3-3b1c4c52abab" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Updating instance_info_cache with network_info: [{"id": "cd78781d-eff7-4100-8263-6717c622c4e4", "address": "fa:16:3e:a9:f6:28", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd78781d-ef", "ovs_interfaceid": "cd78781d-eff7-4100-8263-6717c622c4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Releasing lock "refresh_cache-82e60703-5060-446c-83c3-3b1c4c52abab" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Instance network_info: |[{"id": "cd78781d-eff7-4100-8263-6717c622c4e4", "address": "fa:16:3e:a9:f6:28", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd78781d-ef", "ovs_interfaceid": "cd78781d-eff7-4100-8263-6717c622c4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-31038041-e249-40b5-b54f-3486db83f48b req-1e4c3219-2bfc-4af2-8273-ccfc4f10460e service nova] Acquired lock "refresh_cache-82e60703-5060-446c-83c3-3b1c4c52abab" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.network.neutron [req-31038041-e249-40b5-b54f-3486db83f48b req-1e4c3219-2bfc-4af2-8273-ccfc4f10460e service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Refreshing network info cache for port cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Start _get_guest_xml network_info=[{"id": "cd78781d-eff7-4100-8263-6717c622c4e4", "address": "fa:16:3e:a9:f6:28", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd78781d-ef", "ovs_interfaceid": "cd78781d-eff7-4100-8263-6717c622c4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:57:07 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:57:07 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1200390700',display_name='tempest-VolumesAdminNegativeTest-server-1200390700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1200390700',id=15,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f619f5dec7704081974d9a757c392090',ramdisk_id='',reservation_id='r-wc5e0qgp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-380028141',owner_user_name='tempest-VolumesAdminNegativeTest-380028141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:57:06Z,user_data=None,user_id='5f92e9d1656b4677bc1539c279e60450',uuid=82e60703-5060-446c-83c3-3b1c4c52abab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd78781d-eff7-4100-8263-6717c622c4e4", "address": "fa:16:3e:a9:f6:28", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd78781d-ef", "ovs_interfaceid": "cd78781d-eff7-4100-8263-6717c622c4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Converting VIF {"id": "cd78781d-eff7-4100-8263-6717c622c4e4", "address": "fa:16:3e:a9:f6:28", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd78781d-ef", "ovs_interfaceid": "cd78781d-eff7-4100-8263-6717c622c4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f6:28,bridge_name='br-int',has_traffic_filtering=True,id=cd78781d-eff7-4100-8263-6717c622c4e4,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd78781d-ef') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.objects.instance [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lazy-loading 'pci_devices' on Instance uuid 82e60703-5060-446c-83c3-3b1c4c52abab {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:57:07 user nova-compute[72815]:   <uuid>82e60703-5060-446c-83c3-3b1c4c52abab</uuid>
Aug 17 19:57:07 user nova-compute[72815]:   <name>instance-0000000f</name>
Aug 17 19:57:07 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:57:07 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:57:07 user nova-compute[72815]:   <metadata>
Aug 17 19:57:07 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:57:07 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:57:07 user nova-compute[72815]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1200390700</nova:name>
Aug 17 19:57:07 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:57:07</nova:creationTime>
Aug 17 19:57:07 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:57:07 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:57:07 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:57:07 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:57:07 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:57:07 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:57:07 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:57:07 user nova-compute[72815]:       <nova:owner>
Aug 17 19:57:07 user nova-compute[72815]:         <nova:user uuid="5f92e9d1656b4677bc1539c279e60450">tempest-VolumesAdminNegativeTest-380028141-project-member</nova:user>
Aug 17 19:57:07 user nova-compute[72815]:         <nova:project uuid="f619f5dec7704081974d9a757c392090">tempest-VolumesAdminNegativeTest-380028141</nova:project>
Aug 17 19:57:07 user nova-compute[72815]:       </nova:owner>
Aug 17 19:57:07 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:57:07 user nova-compute[72815]:       <nova:ports>
Aug 17 19:57:07 user nova-compute[72815]:         <nova:port uuid="cd78781d-eff7-4100-8263-6717c622c4e4">
Aug 17 19:57:07 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 19:57:07 user nova-compute[72815]:         </nova:port>
Aug 17 19:57:07 user nova-compute[72815]:       </nova:ports>
Aug 17 19:57:07 user nova-compute[72815]:     </nova:instance>
Aug 17 19:57:07 user nova-compute[72815]:   </metadata>
Aug 17 19:57:07 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:57:07 user nova-compute[72815]:     <system>
Aug 17 19:57:07 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:57:07 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:57:07 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:57:07 user nova-compute[72815]:       <entry name="serial">82e60703-5060-446c-83c3-3b1c4c52abab</entry>
Aug 17 19:57:07 user nova-compute[72815]:       <entry name="uuid">82e60703-5060-446c-83c3-3b1c4c52abab</entry>
Aug 17 19:57:07 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:57:07 user nova-compute[72815]:     </system>
Aug 17 19:57:07 user nova-compute[72815]:   </sysinfo>
Aug 17 19:57:07 user nova-compute[72815]:   <os>
Aug 17 19:57:07 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:57:07 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:57:07 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:57:07 user nova-compute[72815]:   </os>
Aug 17 19:57:07 user nova-compute[72815]:   <features>
Aug 17 19:57:07 user nova-compute[72815]:     <acpi/>
Aug 17 19:57:07 user nova-compute[72815]:     <apic/>
Aug 17 19:57:07 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:57:07 user nova-compute[72815]:   </features>
Aug 17 19:57:07 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:57:07 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:57:07 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:57:07 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:57:07 user nova-compute[72815]:   </clock>
Aug 17 19:57:07 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:57:07 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:57:07 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:57:07 user nova-compute[72815]:   </cpu>
Aug 17 19:57:07 user nova-compute[72815]:   <devices>
Aug 17 19:57:07 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:57:07 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:57:07 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk"/>
Aug 17 19:57:07 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:57:07 user nova-compute[72815]:     </disk>
Aug 17 19:57:07 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:57:07 user nova-compute[72815]:       <mac address="fa:16:3e:a9:f6:28"/>
Aug 17 19:57:07 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:57:07 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:57:07 user nova-compute[72815]:       <target dev="tapcd78781d-ef"/>
Aug 17 19:57:07 user nova-compute[72815]:     </interface>
Aug 17 19:57:07 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:57:07 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/console.log" append="off"/>
Aug 17 19:57:07 user nova-compute[72815]:     </serial>
Aug 17 19:57:07 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:57:07 user nova-compute[72815]:     <video>
Aug 17 19:57:07 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:57:07 user nova-compute[72815]:     </video>
Aug 17 19:57:07 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:57:07 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:57:07 user nova-compute[72815]:     </rng>
Aug 17 19:57:07 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:57:07 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:57:07 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:57:07 user nova-compute[72815]:     </memballoon>
Aug 17 19:57:07 user nova-compute[72815]:   </devices>
Aug 17 19:57:07 user nova-compute[72815]: </domain>
Aug 17 19:57:07 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1200390700',display_name='tempest-VolumesAdminNegativeTest-server-1200390700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1200390700',id=15,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f619f5dec7704081974d9a757c392090',ramdisk_id='',reservation_id='r-wc5e0qgp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-380028141',owner_user_name='tempest-VolumesAdminNegativeTest-380028141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:57:06Z,user_data=None,user_id='5f92e9d1656b4677bc1539c279e60450',uuid=82e60703-5060-446c-83c3-3b1c4c52abab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd78781d-eff7-4100-8263-6717c622c4e4", "address": "fa:16:3e:a9:f6:28", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd78781d-ef", "ovs_interfaceid": "cd78781d-eff7-4100-8263-6717c622c4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Converting VIF {"id": "cd78781d-eff7-4100-8263-6717c622c4e4", "address": "fa:16:3e:a9:f6:28", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd78781d-ef", "ovs_interfaceid": "cd78781d-eff7-4100-8263-6717c622c4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f6:28,bridge_name='br-int',has_traffic_filtering=True,id=cd78781d-eff7-4100-8263-6717c622c4e4,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd78781d-ef') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG os_vif [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f6:28,bridge_name='br-int',has_traffic_filtering=True,id=cd78781d-eff7-4100-8263-6717c622c4e4,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd78781d-ef') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd78781d-ef, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd78781d-ef, col_values=(('external_ids', {'iface-id': 'cd78781d-eff7-4100-8263-6717c622c4e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:f6:28', 'vm-uuid': '82e60703-5060-446c-83c3-3b1c4c52abab'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:07 user nova-compute[72815]: INFO os_vif [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f6:28,bridge_name='br-int',has_traffic_filtering=True,id=cd78781d-eff7-4100-8263-6717c622c4e4,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd78781d-ef')
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] No VIF found with MAC fa:16:3e:a9:f6:28, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.network.neutron [req-31038041-e249-40b5-b54f-3486db83f48b req-1e4c3219-2bfc-4af2-8273-ccfc4f10460e service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Updated VIF entry in instance network info cache for port cd78781d-eff7-4100-8263-6717c622c4e4. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:57:07 user nova-compute[72815]: DEBUG nova.network.neutron [req-31038041-e249-40b5-b54f-3486db83f48b req-1e4c3219-2bfc-4af2-8273-ccfc4f10460e service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Updating instance_info_cache with network_info: [{"id": "cd78781d-eff7-4100-8263-6717c622c4e4", "address": "fa:16:3e:a9:f6:28", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd78781d-ef", "ovs_interfaceid": "cd78781d-eff7-4100-8263-6717c622c4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:57:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-31038041-e249-40b5-b54f-3486db83f48b req-1e4c3219-2bfc-4af2-8273-ccfc4f10460e service nova] Releasing lock "refresh_cache-82e60703-5060-446c-83c3-3b1c4c52abab" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:57:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-4bdabb4c-6e5c-42c3-afad-41e5a1ec33b1 req-88e5f765-d32c-4e1f-a15c-5aed2bcd8286 service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Received event network-vif-plugged-cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4bdabb4c-6e5c-42c3-afad-41e5a1ec33b1 req-88e5f765-d32c-4e1f-a15c-5aed2bcd8286 service nova] Acquiring lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4bdabb4c-6e5c-42c3-afad-41e5a1ec33b1 req-88e5f765-d32c-4e1f-a15c-5aed2bcd8286 service nova] Lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4bdabb4c-6e5c-42c3-afad-41e5a1ec33b1 req-88e5f765-d32c-4e1f-a15c-5aed2bcd8286 service nova] Lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-4bdabb4c-6e5c-42c3-afad-41e5a1ec33b1 req-88e5f765-d32c-4e1f-a15c-5aed2bcd8286 service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] No waiting events found dispatching network-vif-plugged-cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:09 user nova-compute[72815]: WARNING nova.compute.manager [req-4bdabb4c-6e5c-42c3-afad-41e5a1ec33b1 req-88e5f765-d32c-4e1f-a15c-5aed2bcd8286 service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Received unexpected event network-vif-plugged-cd78781d-eff7-4100-8263-6717c622c4e4 for instance with vm_state building and task_state spawning.
Aug 17 19:57:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Acquiring lock "e4a8f42b-da98-4652-be1f-393b790a87f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Acquiring lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:10 user nova-compute[72815]: INFO nova.compute.manager [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Terminating instance
Aug 17 19:57:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-ebd39a11-b382-45f9-82ad-135e095c9e25 req-d59247a4-05fc-4e37-9c4e-ecaddccced16 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Received event network-vif-unplugged-9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ebd39a11-b382-45f9-82ad-135e095c9e25 req-d59247a4-05fc-4e37-9c4e-ecaddccced16 service nova] Acquiring lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ebd39a11-b382-45f9-82ad-135e095c9e25 req-d59247a4-05fc-4e37-9c4e-ecaddccced16 service nova] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ebd39a11-b382-45f9-82ad-135e095c9e25 req-d59247a4-05fc-4e37-9c4e-ecaddccced16 service nova] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-ebd39a11-b382-45f9-82ad-135e095c9e25 req-d59247a4-05fc-4e37-9c4e-ecaddccced16 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] No waiting events found dispatching network-vif-unplugged-9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-ebd39a11-b382-45f9-82ad-135e095c9e25 req-d59247a4-05fc-4e37-9c4e-ecaddccced16 service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Received event network-vif-unplugged-9c5a165c-656c-45af-833a-b69c3b2f73e0 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302231.1984808, 82e60703-5060-446c-83c3-3b1c4c52abab => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:57:11 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] VM Resumed (Lifecycle Event)
Aug 17 19:57:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Instance spawned successfully.
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-e4fc5c1a-abe3-4d45-bbd6-9cdcf6b2fc6d req-2924c28e-90b6-4dfb-8b5d-e4c760da2e19 service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Received event network-vif-plugged-cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e4fc5c1a-abe3-4d45-bbd6-9cdcf6b2fc6d req-2924c28e-90b6-4dfb-8b5d-e4c760da2e19 service nova] Acquiring lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e4fc5c1a-abe3-4d45-bbd6-9cdcf6b2fc6d req-2924c28e-90b6-4dfb-8b5d-e4c760da2e19 service nova] Lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e4fc5c1a-abe3-4d45-bbd6-9cdcf6b2fc6d req-2924c28e-90b6-4dfb-8b5d-e4c760da2e19 service nova] Lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-e4fc5c1a-abe3-4d45-bbd6-9cdcf6b2fc6d req-2924c28e-90b6-4dfb-8b5d-e4c760da2e19 service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] No waiting events found dispatching network-vif-plugged-cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:11 user nova-compute[72815]: WARNING nova.compute.manager [req-e4fc5c1a-abe3-4d45-bbd6-9cdcf6b2fc6d req-2924c28e-90b6-4dfb-8b5d-e4c760da2e19 service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Received unexpected event network-vif-plugged-cd78781d-eff7-4100-8263-6717c622c4e4 for instance with vm_state building and task_state spawning.
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:57:11 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302231.1995766, 82e60703-5060-446c-83c3-3b1c4c52abab => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:57:11 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] VM Started (Lifecycle Event)
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:57:11 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:57:11 user nova-compute[72815]: INFO nova.compute.manager [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Instance destroyed successfully.
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.objects.instance [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lazy-loading 'resources' on Instance uuid e4a8f42b-da98-4652-be1f-393b790a87f1 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1084348631',display_name='tempest-VolumesAssistedSnapshotsTest-server-1084348631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1084348631',id=8,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuEl0yIhyErrry1myadcIGOc9RewPSuBMmBtcFxbi8SkDclXHXRd1xicjabWMA/rnBcd9qxNEqDAxo/IOBNm7pBhyd3CxMnu3Gu2B+HiuhxL21fnvKPGbinVzqKigs4MQ==',key_name='tempest-keypair-1212091376',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:54:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61a41f966cc44316a220e0379417d9f8',ramdisk_id='',reservation_id='r-pcfgj9w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-193187624',owner_user_name='tempest-VolumesAssistedSnapshotsTest-193187624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0d1c860d9814e588e14ba4ceefdac0a',uuid=e4a8f42b-da98-4652-be1f-393b790a87f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "address": "fa:16:3e:60:5d:1b", "network": {"id": "5f00031c-acd2-4226-84e3-c79acbb25528", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1468450531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a41f966cc44316a220e0379417d9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5a165c-65", "ovs_interfaceid": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Converting VIF {"id": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "address": "fa:16:3e:60:5d:1b", "network": {"id": "5f00031c-acd2-4226-84e3-c79acbb25528", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1468450531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a41f966cc44316a220e0379417d9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5a165c-65", "ovs_interfaceid": "9c5a165c-656c-45af-833a-b69c3b2f73e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:5d:1b,bridge_name='br-int',has_traffic_filtering=True,id=9c5a165c-656c-45af-833a-b69c3b2f73e0,network=Network(5f00031c-acd2-4226-84e3-c79acbb25528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5a165c-65') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG os_vif [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:5d:1b,bridge_name='br-int',has_traffic_filtering=True,id=9c5a165c-656c-45af-833a-b69c3b2f73e0,network=Network(5f00031c-acd2-4226-84e3-c79acbb25528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5a165c-65') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c5a165c-65, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:57:11 user nova-compute[72815]: INFO nova.compute.manager [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Took 6.74 seconds to build instance.
Aug 17 19:57:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:11 user nova-compute[72815]: INFO os_vif [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:5d:1b,bridge_name='br-int',has_traffic_filtering=True,id=9c5a165c-656c-45af-833a-b69c3b2f73e0,network=Network(5f00031c-acd2-4226-84e3-c79acbb25528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5a165c-65')
Aug 17 19:57:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Deleting instance files /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1_del
Aug 17 19:57:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Deletion of /opt/stack/data/nova/instances/e4a8f42b-da98-4652-be1f-393b790a87f1_del complete
Aug 17 19:57:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-51910bd6-438c-4205-a478-f05dd439120f tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "82e60703-5060-446c-83c3-3b1c4c52abab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.860s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:11 user nova-compute[72815]: INFO nova.compute.manager [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 17 19:57:11 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 19:57:11 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 19:57:12 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:57:12 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Took 0.93 seconds to deallocate network for instance.
Aug 17 19:57:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-cd6486e2-b70b-4ab6-a58e-bd402445f61b req-929cff47-8e5d-4a3e-9a3c-110e68f7034a service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Received event network-vif-deleted-9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:12 user nova-compute[72815]: INFO nova.compute.manager [req-cd6486e2-b70b-4ab6-a58e-bd402445f61b req-929cff47-8e5d-4a3e-9a3c-110e68f7034a service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Neutron deleted interface 9c5a165c-656c-45af-833a-b69c3b2f73e0; detaching it from the instance and deleting it from the info cache
Aug 17 19:57:12 user nova-compute[72815]: DEBUG nova.network.neutron [req-cd6486e2-b70b-4ab6-a58e-bd402445f61b req-929cff47-8e5d-4a3e-9a3c-110e68f7034a service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:57:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-cd6486e2-b70b-4ab6-a58e-bd402445f61b req-929cff47-8e5d-4a3e-9a3c-110e68f7034a service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Detach interface failed, port_id=9c5a165c-656c-45af-833a-b69c3b2f73e0, reason: Instance e4a8f42b-da98-4652-be1f-393b790a87f1 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 19:57:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-a1be6062-2719-4ad5-9436-4d0a9180f709 req-0c5ec950-5910-4236-90ab-1d88d2259ebc service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Received event network-vif-plugged-9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a1be6062-2719-4ad5-9436-4d0a9180f709 req-0c5ec950-5910-4236-90ab-1d88d2259ebc service nova] Acquiring lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a1be6062-2719-4ad5-9436-4d0a9180f709 req-0c5ec950-5910-4236-90ab-1d88d2259ebc service nova] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a1be6062-2719-4ad5-9436-4d0a9180f709 req-0c5ec950-5910-4236-90ab-1d88d2259ebc service nova] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-a1be6062-2719-4ad5-9436-4d0a9180f709 req-0c5ec950-5910-4236-90ab-1d88d2259ebc service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] No waiting events found dispatching network-vif-plugged-9c5a165c-656c-45af-833a-b69c3b2f73e0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:13 user nova-compute[72815]: WARNING nova.compute.manager [req-a1be6062-2719-4ad5-9436-4d0a9180f709 req-0c5ec950-5910-4236-90ab-1d88d2259ebc service nova] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Received unexpected event network-vif-plugged-9c5a165c-656c-45af-833a-b69c3b2f73e0 for instance with vm_state deleted and task_state None.
Aug 17 19:57:13 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:57:13 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:57:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.572s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:13 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Deleted allocations for instance e4a8f42b-da98-4652-be1f-393b790a87f1
Aug 17 19:57:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4df529c5-08a6-4d06-a331-18de99698a22 tempest-VolumesAssistedSnapshotsTest-193187624 tempest-VolumesAssistedSnapshotsTest-193187624-project-member] Lock "e4a8f42b-da98-4652-be1f-393b790a87f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.790s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:16 user nova-compute[72815]: INFO nova.compute.manager [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Terminating instance
Aug 17 19:57:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 19:57:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-7354a551-1e12-4236-84a3-3b3f929f96ec req-5873d24d-5156-4609-9163-b5f10eb2b9c7 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-vif-unplugged-011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7354a551-1e12-4236-84a3-3b3f929f96ec req-5873d24d-5156-4609-9163-b5f10eb2b9c7 service nova] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7354a551-1e12-4236-84a3-3b3f929f96ec req-5873d24d-5156-4609-9163-b5f10eb2b9c7 service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7354a551-1e12-4236-84a3-3b3f929f96ec req-5873d24d-5156-4609-9163-b5f10eb2b9c7 service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-7354a551-1e12-4236-84a3-3b3f929f96ec req-5873d24d-5156-4609-9163-b5f10eb2b9c7 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] No waiting events found dispatching network-vif-unplugged-011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-7354a551-1e12-4236-84a3-3b3f929f96ec req-5873d24d-5156-4609-9163-b5f10eb2b9c7 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-vif-unplugged-011707bb-905e-49f1-8517-e58e6907e383 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 19:57:17 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Instance destroyed successfully.
Aug 17 19:57:17 user nova-compute[72815]: DEBUG nova.objects.instance [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lazy-loading 'resources' on Instance uuid 07f12446-7bbc-4b95-a79b-99d48fa23d63 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13917815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13917815',id=9,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlbsB/SL5V5htublsblE53rgHUrd9eZYybyL04+s6cojpdS2pEXlZxF8DNM1ntLrIb/vWy80DhnU321He3lWo9jYEzzJlKGMilORzFpyhwZX5aQj4c3XPI1rKA578fn/A==',key_name='tempest-keypair-559643765',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:54:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8ba66c6a1bf494f867c7eec572d4880',ramdisk_id='',reservation_id='r-s5cxnqgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-80529303',owner_user_name='tempest-TaggedAttachmentsTest-80529303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a78dad1c02084db9b032efb86f7a503c',uuid=07f12446-7bbc-4b95-a79b-99d48fa23d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converting VIF {"id": "011707bb-905e-49f1-8517-e58e6907e383", "address": "fa:16:3e:86:31:8b", "network": {"id": "ac4b9ba9-7aff-47f2-ba0a-047652802f38", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602829654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8ba66c6a1bf494f867c7eec572d4880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011707bb-90", "ovs_interfaceid": "011707bb-905e-49f1-8517-e58e6907e383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:31:8b,bridge_name='br-int',has_traffic_filtering=True,id=011707bb-905e-49f1-8517-e58e6907e383,network=Network(ac4b9ba9-7aff-47f2-ba0a-047652802f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011707bb-90') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG os_vif [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:31:8b,bridge_name='br-int',has_traffic_filtering=True,id=011707bb-905e-49f1-8517-e58e6907e383,network=Network(ac4b9ba9-7aff-47f2-ba0a-047652802f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011707bb-90') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap011707bb-90, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:17 user nova-compute[72815]: INFO os_vif [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:31:8b,bridge_name='br-int',has_traffic_filtering=True,id=011707bb-905e-49f1-8517-e58e6907e383,network=Network(ac4b9ba9-7aff-47f2-ba0a-047652802f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011707bb-90')
Aug 17 19:57:17 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Deleting instance files /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63_del
Aug 17 19:57:17 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Deletion of /opt/stack/data/nova/instances/07f12446-7bbc-4b95-a79b-99d48fa23d63_del complete
Aug 17 19:57:17 user nova-compute[72815]: INFO nova.compute.manager [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 19:57:17 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 19:57:17 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 19:57:18 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:57:18 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Took 1.01 seconds to deallocate network for instance.
Aug 17 19:57:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-70b111a5-1fa6-441f-b4e6-3c1b0062b4cd req-772beaca-9a8d-4ba2-b09c-800ba559c1b6 service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-vif-deleted-011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:19 user nova-compute[72815]: DEBUG nova.compute.manager [req-502a779f-645c-49ee-b672-6f3b0c46a48b req-920475e8-8617-4d97-b58a-56a04ea6579a service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received event network-vif-plugged-011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-502a779f-645c-49ee-b672-6f3b0c46a48b req-920475e8-8617-4d97-b58a-56a04ea6579a service nova] Acquiring lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-502a779f-645c-49ee-b672-6f3b0c46a48b req-920475e8-8617-4d97-b58a-56a04ea6579a service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-502a779f-645c-49ee-b672-6f3b0c46a48b req-920475e8-8617-4d97-b58a-56a04ea6579a service nova] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:19 user nova-compute[72815]: DEBUG nova.compute.manager [req-502a779f-645c-49ee-b672-6f3b0c46a48b req-920475e8-8617-4d97-b58a-56a04ea6579a service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] No waiting events found dispatching network-vif-plugged-011707bb-905e-49f1-8517-e58e6907e383 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:19 user nova-compute[72815]: WARNING nova.compute.manager [req-502a779f-645c-49ee-b672-6f3b0c46a48b req-920475e8-8617-4d97-b58a-56a04ea6579a service nova] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Received unexpected event network-vif-plugged-011707bb-905e-49f1-8517-e58e6907e383 for instance with vm_state deleted and task_state None.
Aug 17 19:57:19 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:57:19 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:57:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:19 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Deleted allocations for instance 07f12446-7bbc-4b95-a79b-99d48fa23d63
Aug 17 19:57:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d9108688-9cfe-416e-9a22-4d4cbd7569ea tempest-TaggedAttachmentsTest-80529303 tempest-TaggedAttachmentsTest-80529303-project-member] Lock "07f12446-7bbc-4b95-a79b-99d48fa23d63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.699s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:57:21 user nova-compute[72815]: INFO nova.compute.claims [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Claim successful on node user
Aug 17 19:57:21 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG nova.compute.manager [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG nova.compute.manager [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG nova.network.neutron [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:57:21 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:57:21 user nova-compute[72815]: DEBUG nova.compute.manager [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG nova.policy [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9821282c73174c448f7fca6b65676f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0708d4f49ed4c96b108d1d2aff76871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG nova.compute.manager [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:57:21 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Creating image(s)
Aug 17 19:57:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "/opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "/opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:21 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.209s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk 1073741824" returned: 0 in 0.078s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'flavor' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.205s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:22 user nova-compute[72815]: INFO nova.compute.manager [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Attaching volume bb5ada6a-3d44-40ce-a284-cc2da9e35d06 to /dev/vdb
Aug 17 19:57:22 user nova-compute[72815]: DEBUG nova.network.neutron [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Successfully created port: 8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Cannot resize image /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG nova.objects.instance [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'migration_context' on Instance uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Ensure instance console log exists: /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG os_brick.utils [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cb5a52-9c12-4e0a-b4a1-e579d4b7df0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[94faaf06-88b2-473c-b156-de14476574c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc932136-b0af-44ff-aab3-df243d04249d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ba92c1-00c8-4892-8021-14b538efab4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:57:22 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:57:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b180ca70-251f-4b42-8fdd-b8bed3600f85]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG os_brick.utils [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:57:22 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updating existing volume attachment record: 3608bf04-5c3c-48fc-8aff-005af26015b6 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:57:23 user nova-compute[72815]: DEBUG nova.network.neutron [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Successfully updated port: 8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:57:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "refresh_cache-fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:57:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquired lock "refresh_cache-fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:57:23 user nova-compute[72815]: DEBUG nova.network.neutron [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:57:23 user nova-compute[72815]: DEBUG nova.compute.manager [req-b77120de-0d11-4ef7-86ae-731c56b6be72 req-b77b3424-f1f8-4711-b35c-a1c702dec87c service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received event network-changed-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:23 user nova-compute[72815]: DEBUG nova.compute.manager [req-b77120de-0d11-4ef7-86ae-731c56b6be72 req-b77b3424-f1f8-4711-b35c-a1c702dec87c service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Refreshing instance network info cache due to event network-changed-8efa8696-1a0f-42c7-a009-0700e77b8923. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:57:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b77120de-0d11-4ef7-86ae-731c56b6be72 req-b77b3424-f1f8-4711-b35c-a1c702dec87c service nova] Acquiring lock "refresh_cache-fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:57:23 user nova-compute[72815]: DEBUG nova.network.neutron [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:57:23 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:57:23 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:57:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.network.neutron [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Updating instance_info_cache with network_info: [{"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Releasing lock "refresh_cache-fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.compute.manager [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Instance network_info: |[{"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b77120de-0d11-4ef7-86ae-731c56b6be72 req-b77b3424-f1f8-4711-b35c-a1c702dec87c service nova] Acquired lock "refresh_cache-fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.network.neutron [req-b77120de-0d11-4ef7-86ae-731c56b6be72 req-b77b3424-f1f8-4711-b35c-a1c702dec87c service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Refreshing network info cache for port 8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Start _get_guest_xml network_info=[{"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:57:24 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:57:24 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1853215392',display_name='tempest-tempest.common.compute-instance-1853215392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1853215392',id=16,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDN+itvlDzHBO+C0L5CdVVjN9zLYJQZyVMxIHI48MdeloXzEtFXvxcRexB54et5sFgI02m27W5UFXQX0FgRie2BIaKjkATT3pAVtNYbH9Q9MC8QkDr8EAwxg7wvp+8x62Q==',key_name='tempest-keypair-1413124709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-06lrf0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.objects.instance [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'pci_devices' on Instance uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:57:24 user nova-compute[72815]:   <uuid>fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0</uuid>
Aug 17 19:57:24 user nova-compute[72815]:   <name>instance-00000010</name>
Aug 17 19:57:24 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:57:24 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:57:24 user nova-compute[72815]:   <metadata>
Aug 17 19:57:24 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:57:24 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:57:24 user nova-compute[72815]:       <nova:name>tempest-tempest.common.compute-instance-1853215392</nova:name>
Aug 17 19:57:24 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:57:24</nova:creationTime>
Aug 17 19:57:24 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:57:24 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:57:24 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:57:24 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:57:24 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:57:24 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:57:24 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:57:24 user nova-compute[72815]:       <nova:owner>
Aug 17 19:57:24 user nova-compute[72815]:         <nova:user uuid="9821282c73174c448f7fca6b65676f61">tempest-ServerActionsTestOtherA-629489909-project-member</nova:user>
Aug 17 19:57:24 user nova-compute[72815]:         <nova:project uuid="a0708d4f49ed4c96b108d1d2aff76871">tempest-ServerActionsTestOtherA-629489909</nova:project>
Aug 17 19:57:24 user nova-compute[72815]:       </nova:owner>
Aug 17 19:57:24 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:57:24 user nova-compute[72815]:       <nova:ports>
Aug 17 19:57:24 user nova-compute[72815]:         <nova:port uuid="8efa8696-1a0f-42c7-a009-0700e77b8923">
Aug 17 19:57:24 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 19:57:24 user nova-compute[72815]:         </nova:port>
Aug 17 19:57:24 user nova-compute[72815]:       </nova:ports>
Aug 17 19:57:24 user nova-compute[72815]:     </nova:instance>
Aug 17 19:57:24 user nova-compute[72815]:   </metadata>
Aug 17 19:57:24 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:57:24 user nova-compute[72815]:     <system>
Aug 17 19:57:24 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:57:24 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:57:24 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:57:24 user nova-compute[72815]:       <entry name="serial">fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0</entry>
Aug 17 19:57:24 user nova-compute[72815]:       <entry name="uuid">fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0</entry>
Aug 17 19:57:24 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:57:24 user nova-compute[72815]:     </system>
Aug 17 19:57:24 user nova-compute[72815]:   </sysinfo>
Aug 17 19:57:24 user nova-compute[72815]:   <os>
Aug 17 19:57:24 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:57:24 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:57:24 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:57:24 user nova-compute[72815]:   </os>
Aug 17 19:57:24 user nova-compute[72815]:   <features>
Aug 17 19:57:24 user nova-compute[72815]:     <acpi/>
Aug 17 19:57:24 user nova-compute[72815]:     <apic/>
Aug 17 19:57:24 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:57:24 user nova-compute[72815]:   </features>
Aug 17 19:57:24 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:57:24 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:57:24 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:57:24 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:57:24 user nova-compute[72815]:   </clock>
Aug 17 19:57:24 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:57:24 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:57:24 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:57:24 user nova-compute[72815]:   </cpu>
Aug 17 19:57:24 user nova-compute[72815]:   <devices>
Aug 17 19:57:24 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:57:24 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:57:24 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk"/>
Aug 17 19:57:24 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:57:24 user nova-compute[72815]:     </disk>
Aug 17 19:57:24 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:57:24 user nova-compute[72815]:       <mac address="fa:16:3e:e8:55:36"/>
Aug 17 19:57:24 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:57:24 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:57:24 user nova-compute[72815]:       <target dev="tap8efa8696-1a"/>
Aug 17 19:57:24 user nova-compute[72815]:     </interface>
Aug 17 19:57:24 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:57:24 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/console.log" append="off"/>
Aug 17 19:57:24 user nova-compute[72815]:     </serial>
Aug 17 19:57:24 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:57:24 user nova-compute[72815]:     <video>
Aug 17 19:57:24 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:57:24 user nova-compute[72815]:     </video>
Aug 17 19:57:24 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:57:24 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:57:24 user nova-compute[72815]:     </rng>
Aug 17 19:57:24 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:57:24 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:57:24 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:57:24 user nova-compute[72815]:     </memballoon>
Aug 17 19:57:24 user nova-compute[72815]:   </devices>
Aug 17 19:57:24 user nova-compute[72815]: </domain>
Aug 17 19:57:24 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1853215392',display_name='tempest-tempest.common.compute-instance-1853215392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1853215392',id=16,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDN+itvlDzHBO+C0L5CdVVjN9zLYJQZyVMxIHI48MdeloXzEtFXvxcRexB54et5sFgI02m27W5UFXQX0FgRie2BIaKjkATT3pAVtNYbH9Q9MC8QkDr8EAwxg7wvp+8x62Q==',key_name='tempest-keypair-1413124709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-06lrf0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG os_vif [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8efa8696-1a, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8efa8696-1a, col_values=(('external_ids', {'iface-id': '8efa8696-1a0f-42c7-a009-0700e77b8923', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:55:36', 'vm-uuid': 'fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:24 user nova-compute[72815]: INFO os_vif [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a')
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No VIF found with MAC fa:16:3e:e8:55:36, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.network.neutron [req-b77120de-0d11-4ef7-86ae-731c56b6be72 req-b77b3424-f1f8-4711-b35c-a1c702dec87c service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Updated VIF entry in instance network info cache for port 8efa8696-1a0f-42c7-a009-0700e77b8923. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG nova.network.neutron [req-b77120de-0d11-4ef7-86ae-731c56b6be72 req-b77b3424-f1f8-4711-b35c-a1c702dec87c service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Updating instance_info_cache with network_info: [{"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b77120de-0d11-4ef7-86ae-731c56b6be72 req-b77b3424-f1f8-4711-b35c-a1c702dec87c service nova] Releasing lock "refresh_cache-fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:57:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG nova.compute.manager [req-d97a46cf-f496-4adc-8ed1-8f086d2a3dcf req-63241da9-9497-4d16-9f65-41ac41f89288 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received event network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d97a46cf-f496-4adc-8ed1-8f086d2a3dcf req-63241da9-9497-4d16-9f65-41ac41f89288 service nova] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d97a46cf-f496-4adc-8ed1-8f086d2a3dcf req-63241da9-9497-4d16-9f65-41ac41f89288 service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d97a46cf-f496-4adc-8ed1-8f086d2a3dcf req-63241da9-9497-4d16-9f65-41ac41f89288 service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:25 user nova-compute[72815]: DEBUG nova.compute.manager [req-d97a46cf-f496-4adc-8ed1-8f086d2a3dcf req-63241da9-9497-4d16-9f65-41ac41f89288 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] No waiting events found dispatching network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:25 user nova-compute[72815]: WARNING nova.compute.manager [req-d97a46cf-f496-4adc-8ed1-8f086d2a3dcf req-63241da9-9497-4d16-9f65-41ac41f89288 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received unexpected event network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 for instance with vm_state building and task_state spawning.
Aug 17 19:57:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:57:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:57:26 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:57:26 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302231.4936917, e4a8f42b-da98-4652-be1f-393b790a87f1 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:57:26 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] VM Stopped (Lifecycle Event)
Aug 17 19:57:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f68b5418-67b8-4f3a-abbc-10de3d4f823f None None] [instance: e4a8f42b-da98-4652-be1f-393b790a87f1] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:26 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updating instance_info_cache with network_info: [{"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:57:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:57:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:57:26 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:57:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:26 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:57:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:57:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-6f607a63-94b1-401f-bcdd-e5907688dbed req-ca01bb59-4b13-41d4-89be-8834d182b205 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received event network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6f607a63-94b1-401f-bcdd-e5907688dbed req-ca01bb59-4b13-41d4-89be-8834d182b205 service nova] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6f607a63-94b1-401f-bcdd-e5907688dbed req-ca01bb59-4b13-41d4-89be-8834d182b205 service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6f607a63-94b1-401f-bcdd-e5907688dbed req-ca01bb59-4b13-41d4-89be-8834d182b205 service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-6f607a63-94b1-401f-bcdd-e5907688dbed req-ca01bb59-4b13-41d4-89be-8834d182b205 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] No waiting events found dispatching network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:28 user nova-compute[72815]: WARNING nova.compute.manager [req-6f607a63-94b1-401f-bcdd-e5907688dbed req-ca01bb59-4b13-41d4-89be-8834d182b205 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received unexpected event network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 for instance with vm_state building and task_state spawning.
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302248.0522957, fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:57:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] VM Resumed (Lifecycle Event)
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:57:28 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Instance spawned successfully.
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:57:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302248.0529573, fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:57:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] VM Started (Lifecycle Event)
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:57:28 user nova-compute[72815]: INFO nova.compute.manager [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 17 19:57:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:57:28 user nova-compute[72815]: INFO nova.compute.manager [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Took 7.27 seconds to build instance.
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-520de8d4-4f0e-4e45-b3c8-97df08333f0a tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.378s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:57:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:57:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:31 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:57:31 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7196MB free_disk=25.732967376708984GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 541f3b1c-207c-4398-ad60-ea50e89d7327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 3a4f27f3-4573-43b5-827a-bbdae4ebce10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 01fdb794-dc6b-412b-95e1-c6c80cb81ecf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 07d46763-1b59-4cce-9e10-e94d0efea05d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 45b6365f-333f-45f1-b619-3453cbe75a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 82e60703-5060-446c-83c3-3b1c4c52abab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 969a1301-2014-4b22-8074-a0ac35136249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:57:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:57:32 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:57:32 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:57:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:57:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.628s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:32 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302237.513973, 07f12446-7bbc-4b95-a79b-99d48fa23d63 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:57:32 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] VM Stopped (Lifecycle Event)
Aug 17 19:57:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-cfe8e3d6-301f-4cd0-bfa9-a7c722dd15f2 None None] [instance: 07f12446-7bbc-4b95-a79b-99d48fa23d63] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:32 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:57:32 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVRnfvcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:57:34 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:57:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:57:34 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:57:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:57:34 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:57:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61dc9c0-9fdd-476a-9f86-2826fcbf712b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:57:34 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[406ef1f1-4c72-4448-8176-2bd3665c71ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06] added
Aug 17 19:57:34 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e4f0c7-1e95-4f89-9841-54c309bbfeed]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b887a245-118e-4acd-858a-b54b24080e4d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVRnfvcK {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVRnfvcK" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8c4054-2b48-49dc-bb67-10aea5175c79]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yVRnfvcK'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2532d57a-0048-47ba-86ae-cc3be227747e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6371943-fc36-46b5-95b2-a76392af2ff8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:35 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:35 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:35 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:35 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac06e8dd-299b-4f09-ba06-fe03251246cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06, portal: 172.16.0.220,3260]
Aug 17 19:57:35 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06, portal: 172.16.0.220,3260] successful.
Aug 17 19:57:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4959932b-ed1d-4304-8160-aecb3148a5ab]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e66de3-5eb3-429d-9076-a80a05ffed3b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:35 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:35 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:57:35 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:35 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:35 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:57:35 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64b2e27-6368-4467-92ce-e2ed998245ab]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVRnfvcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:57:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:57:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26161353935653162', 'path': '/dev/sdd'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:57:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161353935653162', 'path': '/dev/sdd'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:57:36 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'flavor' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:57:36 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:57:36 user nova-compute[72815]:   <source dev="/dev/sdd"/>
Aug 17 19:57:36 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:57:36 user nova-compute[72815]:   <serial>bb5ada6a-3d44-40ce-a284-cc2da9e35d06</serial>
Aug 17 19:57:36 user nova-compute[72815]: </disk>
Aug 17 19:57:36 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:57:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:57:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:57:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] No VIF found with MAC fa:16:3e:38:1e:21, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:57:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a77d8060-0dca-4cda-b9e3-c5d53d82e98b tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.114s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:38 user nova-compute[72815]: INFO nova.compute.manager [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Rescuing
Aug 17 19:57:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:57:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquired lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:57:38 user nova-compute[72815]: DEBUG nova.network.neutron [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:57:38 user nova-compute[72815]: DEBUG nova.network.neutron [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updating instance_info_cache with network_info: [{"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:57:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Releasing lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:57:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-f3032955-438f-432f-ab11-6969c4d1d10d req-069d1014-636e-44d0-99ed-a97b3b07c83d service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-unplugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f3032955-438f-432f-ab11-6969c4d1d10d req-069d1014-636e-44d0-99ed-a97b3b07c83d service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f3032955-438f-432f-ab11-6969c4d1d10d req-069d1014-636e-44d0-99ed-a97b3b07c83d service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f3032955-438f-432f-ab11-6969c4d1d10d req-069d1014-636e-44d0-99ed-a97b3b07c83d service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-f3032955-438f-432f-ab11-6969c4d1d10d req-069d1014-636e-44d0-99ed-a97b3b07c83d service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-unplugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:39 user nova-compute[72815]: WARNING nova.compute.manager [req-f3032955-438f-432f-ab11-6969c4d1d10d req-069d1014-636e-44d0-99ed-a97b3b07c83d service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-unplugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state active and task_state rescuing.
Aug 17 19:57:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Instance destroyed successfully.
Aug 17 19:57:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Attempting a stable device rescue
Aug 17 19:57:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72815) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 19:57:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Instance directory exists: not creating {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 19:57:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Creating image(s)
Aug 17 19:57:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "/opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "/opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "/opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:39 user nova-compute[72815]: DEBUG nova.objects.instance [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'trusted_certs' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "43e1548167728acd8c409a75c9486f5479d0cfff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "43e1548167728acd8c409a75c9486f5479d0cfff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff.part --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff.part --force-share --output=json" returned: 0 in 0.172s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:40 user nova-compute[72815]: DEBUG nova.virt.images [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] 19b8eb82-5c54-4d70-ae17-e11b16cfe35a was qcow2, converting to raw {{(pid=72815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 19:57:40 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 19:57:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff.part /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff.converted {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:40 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquired lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'info_cache' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-032bff94-4462-46d4-9c76-efc68206a06b req-5a410a70-be2a-4863-a673-78cf51bba35b service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-032bff94-4462-46d4-9c76-efc68206a06b req-5a410a70-be2a-4863-a673-78cf51bba35b service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-032bff94-4462-46d4-9c76-efc68206a06b req-5a410a70-be2a-4863-a673-78cf51bba35b service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-032bff94-4462-46d4-9c76-efc68206a06b req-5a410a70-be2a-4863-a673-78cf51bba35b service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-032bff94-4462-46d4-9c76-efc68206a06b req-5a410a70-be2a-4863-a673-78cf51bba35b service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:41 user nova-compute[72815]: WARNING nova.compute.manager [req-032bff94-4462-46d4-9c76-efc68206a06b req-5a410a70-be2a-4863-a673-78cf51bba35b service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state active and task_state rescuing.
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff.part /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff.converted" returned: 0 in 0.470s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff.converted --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "43e1548167728acd8c409a75c9486f5479d0cfff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.784s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "43e1548167728acd8c409a75c9486f5479d0cfff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "43e1548167728acd8c409a75c9486f5479d0cfff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff,backing_fmt=raw /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.rescue {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff,backing_fmt=raw /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.rescue" returned: 0 in 0.049s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "43e1548167728acd8c409a75c9486f5479d0cfff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'migration_context' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Start _get_guest_xml network_info=[{"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "vif_mac": "fa:16:3e:38:1e:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '19b8eb82-5c54-4d70-ae17-e11b16cfe35a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': '3608bf04-5c3c-48fc-8aff-005af26015b6', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVRnfvcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '07d46763-1b59-4cce-9e10-e94d0efea05d', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb5ada6a-3d44-40ce-a284-cc2da9e35d06', 'serial': 'bb5ada6a-3d44-40ce-a284-cc2da9e35d06'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'resources' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'numa_topology' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:41 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:57:41 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'vcpu_model' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVRnfvcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:57:41 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:57:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:57:41 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:57:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:57:41 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb84939-1629-43d0-a157-d04eba226a39]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yVRnfvcK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 19:57:41 user nova-compute[72815]: node.name = iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06
Aug 17 19:57:41 user nova-compute[72815]: node.tpgt = -1
Aug 17 19:57:41 user nova-compute[72815]: node.startup = automatic
Aug 17 19:57:41 user nova-compute[72815]: node.leading_login = No
Aug 17 19:57:41 user nova-compute[72815]: iface.iscsi_ifacename = default
Aug 17 19:57:41 user nova-compute[72815]: iface.net_ifacename = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.ipaddress = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.prefix_len = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.hwaddress = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.transport_name = tcp
Aug 17 19:57:41 user nova-compute[72815]: iface.initiatorname = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.state = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.vlan_id = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.vlan_priority = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.vlan_state = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.iface_num = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.mtu = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.port = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.bootproto = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.subnet_mask = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.gateway = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.dhcp_alt_client_id = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.dhcp_dns = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.dhcp_learn_iqn = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.dhcp_vendor_id_state = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.dhcp_vendor_id = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.dhcp_slp_da = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.fragmentation = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.gratuitous_arp = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.incoming_forwarding = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.tos_state = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.tos = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.ttl = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.delayed_ack = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.tcp_nagle = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.tcp_wsf_state = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.tcp_wsf = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.tcp_timer_scale = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.tcp_timestamp = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.redirect = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.def_task_mgmt_timeout = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.header_digest = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.data_digest = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.immediate_data = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.initial_r2t = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.data_seq_inorder = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.data_pdu_inorder = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.erl = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.max_receive_data_len = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.first_burst_len = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.max_outstanding_r2t = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.max_burst_len = 0
Aug 17 19:57:41 user nova-compute[72815]: iface.chap_auth = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.bidi_chap = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.strict_login_compliance = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.discovery_auth = <empty>
Aug 17 19:57:41 user nova-compute[72815]: iface.discovery_logout = <empty>
Aug 17 19:57:41 user nova-compute[72815]: node.discovery_address = <empty>
Aug 17 19:57:41 user nova-compute[72815]: node.discovery_port = 0
Aug 17 19:57:41 user nova-compute[72815]: node.discovery_type = static
Aug 17 19:57:41 user nova-compute[72815]: node.session.initial_cmdsn = 0
Aug 17 19:57:41 user nova-compute[72815]: node.session.initial_login_retry_max = 8
Aug 17 19:57:41 user nova-compute[72815]: node.session.xmit_thread_priority = -20
Aug 17 19:57:41 user nova-compute[72815]: node.session.cmds_max = 128
Aug 17 19:57:41 user nova-compute[72815]: node.session.queue_depth = 32
Aug 17 19:57:41 user nova-compute[72815]: node.session.nr_sessions = 1
Aug 17 19:57:41 user nova-compute[72815]: node.session.auth.authmethod = CHAP
Aug 17 19:57:41 user nova-compute[72815]: node.session.auth.username = yVRnfvcK
Aug 17 19:57:41 user nova-compute[72815]: node.session.auth.password = ***
Aug 17 19:57:41 user nova-compute[72815]: node.session.auth.username_in = <empty>
Aug 17 19:57:41 user nova-compute[72815]: node.session.auth.password_in = <empty>
Aug 17 19:57:41 user nova-compute[72815]: node.session.auth.chap_algs = MD5
Aug 17 19:57:41 user nova-compute[72815]: node.session.timeo.replacement_timeout = 120
Aug 17 19:57:41 user nova-compute[72815]: node.session.err_timeo.abort_timeout = 15
Aug 17 19:57:41 user nova-compute[72815]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 19:57:41 user nova-compute[72815]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 19:57:41 user nova-compute[72815]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 19:57:41 user nova-compute[72815]: node.session.iscsi.FastAbort = Yes
Aug 17 19:57:41 user nova-compute[72815]: node.session.iscsi.InitialR2T = No
Aug 17 19:57:41 user nova-compute[72815]: node.session.iscsi.ImmediateData = Yes
Aug 17 19:57:41 user nova-compute[72815]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 19:57:41 user nova-compute[72815]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 19:57:41 user nova-compute[72815]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 19:57:41 user nova-compute[72815]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 19:57:41 user nova-compute[72815]: node.session.iscsi.MaxConnections = 1
Aug 17 19:57:41 user nova-compute[72815]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 19:57:41 user nova-compute[72815]: node.session.iscsi.ERL = 0
Aug 17 19:57:41 user nova-compute[72815]: node.session.scan = manual
Aug 17 19:57:41 user nova-compute[72815]: node.session.reopen_max = 0
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].address = 172.16.0.220
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].port = 3260
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].startup = manual
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].tcp.window_size = 524288
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].tcp.type_of_service = 0
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].timeo.logout_timeout = 15
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].timeo.login_timeout = 15
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].timeo.auth_timeout = 45
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].iscsi.DataDigest = None
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].iscsi.IFMarker = No
Aug 17 19:57:41 user nova-compute[72815]: node.conn[0].iscsi.OFMarker = No
Aug 17 19:57:41 user nova-compute[72815]: # END RECORD
Aug 17 19:57:41 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a870c08c-0e6a-4416-aeec-0d94ce6a9d68]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bf7208-5ff3-4a51-91b2-7b2365f8d7e9]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVRnfvcK {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVRnfvcK" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[76693ca7-31d0-42de-8d31-fe3e0b228564]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yVRnfvcK'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d543440d-3255-4a84-9e44-784438578fca]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e742e0ef-de55-47ad-939a-d76ac9a95e52]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:42 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:42 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:57:42 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:42 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:42 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:42 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:57:42 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:42 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] HCTL ('35', '0', '0', 0) found on session 13 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b41f8f8-5962-4600-9ac8-4e7554d3318b]: (4, ('0 0 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Searching for a device in session 13 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVRnfvcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '26161353935653162', 'path': '/dev/sdd'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161353935653162', 'path': '/dev/sdd'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-17342816',display_name='tempest-ServerStableDeviceRescueTest-server-17342816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-17342816',id=4,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJrunJLrimEM+Gxd+hZ0sJyZLFWCB51uwbX7BQYwnQxoGyp8d2DETwVwLuci+7ubf+bNZxthaOWRg3z6FnbUfc/e9ggUpquvSY1IwPjdo3Nh8aVScHbxFmWLdJGFJkMXQ==',key_name='tempest-keypair-1184284913',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b85a305cdf974d10a935caff8ccec9b4',ramdisk_id='',reservation_id='r-bm8bw4wj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-344410182',owner_user_name='tempest-ServerStableDeviceRescueTest-344410182-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:55:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c83afcb788d541d1a3f8c75e5a39c6ce',uuid=07d46763-1b59-4cce-9e10-e94d0efea05d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "vif_mac": "fa:16:3e:38:1e:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Converting VIF {"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "vif_mac": "fa:16:3e:38:1e:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:1e:21,bridge_name='br-int',has_traffic_filtering=True,id=991f5622-2c12-4ea1-950b-19b55e89c57c,network=Network(557c4953-b996-4cb6-8b45-a1ca6ec545f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991f5622-2c') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.objects.instance [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'pci_devices' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:57:42 user nova-compute[72815]:   <uuid>07d46763-1b59-4cce-9e10-e94d0efea05d</uuid>
Aug 17 19:57:42 user nova-compute[72815]:   <name>instance-00000004</name>
Aug 17 19:57:42 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:57:42 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:57:42 user nova-compute[72815]:   <metadata>
Aug 17 19:57:42 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:57:42 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:57:42 user nova-compute[72815]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-17342816</nova:name>
Aug 17 19:57:42 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:57:41</nova:creationTime>
Aug 17 19:57:42 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:57:42 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:57:42 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:57:42 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:57:42 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:57:42 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:57:42 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:57:42 user nova-compute[72815]:       <nova:owner>
Aug 17 19:57:42 user nova-compute[72815]:         <nova:user uuid="c83afcb788d541d1a3f8c75e5a39c6ce">tempest-ServerStableDeviceRescueTest-344410182-project-member</nova:user>
Aug 17 19:57:42 user nova-compute[72815]:         <nova:project uuid="b85a305cdf974d10a935caff8ccec9b4">tempest-ServerStableDeviceRescueTest-344410182</nova:project>
Aug 17 19:57:42 user nova-compute[72815]:       </nova:owner>
Aug 17 19:57:42 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:57:42 user nova-compute[72815]:       <nova:ports>
Aug 17 19:57:42 user nova-compute[72815]:         <nova:port uuid="991f5622-2c12-4ea1-950b-19b55e89c57c">
Aug 17 19:57:42 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 19:57:42 user nova-compute[72815]:         </nova:port>
Aug 17 19:57:42 user nova-compute[72815]:       </nova:ports>
Aug 17 19:57:42 user nova-compute[72815]:     </nova:instance>
Aug 17 19:57:42 user nova-compute[72815]:   </metadata>
Aug 17 19:57:42 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:57:42 user nova-compute[72815]:     <system>
Aug 17 19:57:42 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:57:42 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:57:42 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:57:42 user nova-compute[72815]:       <entry name="serial">07d46763-1b59-4cce-9e10-e94d0efea05d</entry>
Aug 17 19:57:42 user nova-compute[72815]:       <entry name="uuid">07d46763-1b59-4cce-9e10-e94d0efea05d</entry>
Aug 17 19:57:42 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:57:42 user nova-compute[72815]:     </system>
Aug 17 19:57:42 user nova-compute[72815]:   </sysinfo>
Aug 17 19:57:42 user nova-compute[72815]:   <os>
Aug 17 19:57:42 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:57:42 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:57:42 user nova-compute[72815]:   </os>
Aug 17 19:57:42 user nova-compute[72815]:   <features>
Aug 17 19:57:42 user nova-compute[72815]:     <acpi/>
Aug 17 19:57:42 user nova-compute[72815]:     <apic/>
Aug 17 19:57:42 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:57:42 user nova-compute[72815]:   </features>
Aug 17 19:57:42 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:57:42 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:57:42 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:57:42 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:57:42 user nova-compute[72815]:   </clock>
Aug 17 19:57:42 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:57:42 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:57:42 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:57:42 user nova-compute[72815]:   </cpu>
Aug 17 19:57:42 user nova-compute[72815]:   <devices>
Aug 17 19:57:42 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:57:42 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:57:42 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk"/>
Aug 17 19:57:42 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:57:42 user nova-compute[72815]:     </disk>
Aug 17 19:57:42 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 19:57:42 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:57:42 user nova-compute[72815]:       <source dev="/dev/sdd"/>
Aug 17 19:57:42 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 19:57:42 user nova-compute[72815]:       <serial>bb5ada6a-3d44-40ce-a284-cc2da9e35d06</serial>
Aug 17 19:57:42 user nova-compute[72815]:     </disk>
Aug 17 19:57:42 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:57:42 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:57:42 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.rescue"/>
Aug 17 19:57:42 user nova-compute[72815]:       <target dev="vdc" bus="virtio"/>
Aug 17 19:57:42 user nova-compute[72815]:       <boot order="1"/>
Aug 17 19:57:42 user nova-compute[72815]:     </disk>
Aug 17 19:57:42 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:57:42 user nova-compute[72815]:       <mac address="fa:16:3e:38:1e:21"/>
Aug 17 19:57:42 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:57:42 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:57:42 user nova-compute[72815]:       <target dev="tap991f5622-2c"/>
Aug 17 19:57:42 user nova-compute[72815]:     </interface>
Aug 17 19:57:42 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:57:42 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/console.log" append="off"/>
Aug 17 19:57:42 user nova-compute[72815]:     </serial>
Aug 17 19:57:42 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:57:42 user nova-compute[72815]:     <video>
Aug 17 19:57:42 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:57:42 user nova-compute[72815]:     </video>
Aug 17 19:57:42 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:57:42 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:57:42 user nova-compute[72815]:     </rng>
Aug 17 19:57:42 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:57:42 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:57:42 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:57:42 user nova-compute[72815]:     </memballoon>
Aug 17 19:57:42 user nova-compute[72815]:   </devices>
Aug 17 19:57:42 user nova-compute[72815]: </domain>
Aug 17 19:57:42 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:57:42 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Instance destroyed successfully.
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] No VIF found with MAC fa:16:3e:38:1e:21, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Updating instance_info_cache with network_info: [{"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Releasing lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:57:42 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance destroyed successfully.
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'resources' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643279889',display_name='tempest-AttachVolumeTestJSON-server-643279889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643279889',id=5,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESF266QwfIKeTik8wnoygIiOf2r6BrCWxIIzDojrbBZKm/zXPBtL9YHLKhpKFS8eHXyHAtcWfIKVJD6LLHKDkJll+G0nOWdMGtF8im19Z7tm6u5x2HPboD1YjRBA8g36A==',key_name='tempest-keypair-447370262',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:53:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fb016b8ab299475e9f916809c7b55182',ramdisk_id='',reservation_id='r-0ehl5jun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1462912324',owner_user_name='tempest-AttachVolumeTestJSON-1462912324-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:55:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c894534b34d943229dc89f6d58836acb',uuid=1800ab7b-dd88-45fb-9370-1b77b8cbf893,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converting VIF {"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_vif [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d010d95-17, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:42 user nova-compute[72815]: INFO os_vif [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17')
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMXxRwDl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:57:42 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec443f7-c75a-44cc-80fe-9bb86bac5387]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd92217e-23fa-417a-ae22-01658147c5f3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:42 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:42 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:57:42 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:42 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:42 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:42 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:57:42 user nova-compute[72815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:42 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399444ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db'): ({'sdb'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Removing single pathed devices sdb {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9823fb-652f-4b31-aa64-9a82d633109c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c6a82d-9b9b-4ff1-b65c-2d0dbdf79761]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Flushing IO for device /dev/sdb {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ab915b-26ac-4f22-a576-f82a2d706a2b]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[565e746e-5dd5-4026-9042-3b962d844b0e]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1e1301-f5ae-452d-bf1c-adeebdee086a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6a4e14-947d-4fbe-b6eb-0a39f75f3383]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260]
Aug 17 19:57:42 user nova-compute[72815]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260] successful.
Aug 17 19:57:42 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c31420-6b0f-4714-9aa4-524f2910ac3d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] <== disconnect_volume: return (269ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Start _get_guest_xml network_info=[{"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': '8a98a6c3-1768-486f-9190-73532ab2f88e', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMXxRwDl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1800ab7b-dd88-45fb-9370-1b77b8cbf893', 'attached_at': '', 'detached_at': '', 'volume_id': '1c79b4ad-2ef9-42ee-8f37-aad0b223c4db', 'serial': '1c79b4ad-2ef9-42ee-8f37-aad0b223c4db'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'numa_topology' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:42 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:57:42 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMXxRwDl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:57:42 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:57:42 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:57:42 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d5900-d6d5-4ed4-bb33-00c943e85ee3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:57:42 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[793334cb-85cd-429e-92ac-d1872eff64e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db] added
Aug 17 19:57:42 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd85f492-933a-410a-9bfd-c63e0580c270]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4441a0-19f6-49ff-9e41-432a61a9fc0b]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMXxRwDl {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMXxRwDl" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c311db-82f3-4a33-af68-be8f57100f41]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VMXxRwDl'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8381c292-3114-435d-8bff-0ebf2929c2ad]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0f25f8-03f4-4125-9d83-ac0d5c77bb60]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:43 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:43 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:57:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:43 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:43 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:57:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b8362e-a32b-4afd-8c7c-c39251172e3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260]
Aug 17 19:57:43 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260] successful.
Aug 17 19:57:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[424eb9d0-abe9-48d5-b277-8fbc6a7f412e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b5ff27-7ddc-45d5-8f28-b4650ac4efd3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:43 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:43 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:57:43 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:57:43 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:57:43 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:57:43 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:57:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4996862e-5d9b-42dc-b872-fb5377206152]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMXxRwDl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-63530df8-f5b2-43df-a21e-5835bf7c87ce req-edf2fae5-cd53-456a-b686-b1796da7de89 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-63530df8-f5b2-43df-a21e-5835bf7c87ce req-edf2fae5-cd53-456a-b686-b1796da7de89 service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-63530df8-f5b2-43df-a21e-5835bf7c87ce req-edf2fae5-cd53-456a-b686-b1796da7de89 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-63530df8-f5b2-43df-a21e-5835bf7c87ce req-edf2fae5-cd53-456a-b686-b1796da7de89 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-63530df8-f5b2-43df-a21e-5835bf7c87ce req-edf2fae5-cd53-456a-b686-b1796da7de89 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:43 user nova-compute[72815]: WARNING nova.compute.manager [req-63530df8-f5b2-43df-a21e-5835bf7c87ce req-edf2fae5-cd53-456a-b686-b1796da7de89 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state active and task_state rescuing.
Aug 17 19:57:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26538353632323238', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538353632323238', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643279889',display_name='tempest-AttachVolumeTestJSON-server-643279889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643279889',id=5,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESF266QwfIKeTik8wnoygIiOf2r6BrCWxIIzDojrbBZKm/zXPBtL9YHLKhpKFS8eHXyHAtcWfIKVJD6LLHKDkJll+G0nOWdMGtF8im19Z7tm6u5x2HPboD1YjRBA8g36A==',key_name='tempest-keypair-447370262',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:53:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fb016b8ab299475e9f916809c7b55182',ramdisk_id='',reservation_id='r-0ehl5jun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1462912324',owner_user_name='tempest-AttachVolumeTestJSON-1462912324-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:55:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c894534b34d943229dc89f6d58836acb',uuid=1800ab7b-dd88-45fb-9370-1b77b8cbf893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converting VIF {"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'pci_devices' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:57:44 user nova-compute[72815]:   <uuid>1800ab7b-dd88-45fb-9370-1b77b8cbf893</uuid>
Aug 17 19:57:44 user nova-compute[72815]:   <name>instance-00000005</name>
Aug 17 19:57:44 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:57:44 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:57:44 user nova-compute[72815]:   <metadata>
Aug 17 19:57:44 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:57:44 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:57:44 user nova-compute[72815]:       <nova:name>tempest-AttachVolumeTestJSON-server-643279889</nova:name>
Aug 17 19:57:44 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:57:42</nova:creationTime>
Aug 17 19:57:44 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:57:44 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:57:44 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:57:44 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:57:44 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:57:44 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:57:44 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:57:44 user nova-compute[72815]:       <nova:owner>
Aug 17 19:57:44 user nova-compute[72815]:         <nova:user uuid="c894534b34d943229dc89f6d58836acb">tempest-AttachVolumeTestJSON-1462912324-project-member</nova:user>
Aug 17 19:57:44 user nova-compute[72815]:         <nova:project uuid="fb016b8ab299475e9f916809c7b55182">tempest-AttachVolumeTestJSON-1462912324</nova:project>
Aug 17 19:57:44 user nova-compute[72815]:       </nova:owner>
Aug 17 19:57:44 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:57:44 user nova-compute[72815]:       <nova:ports>
Aug 17 19:57:44 user nova-compute[72815]:         <nova:port uuid="7d010d95-173c-44df-be70-170e3ca59b0e">
Aug 17 19:57:44 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 19:57:44 user nova-compute[72815]:         </nova:port>
Aug 17 19:57:44 user nova-compute[72815]:       </nova:ports>
Aug 17 19:57:44 user nova-compute[72815]:     </nova:instance>
Aug 17 19:57:44 user nova-compute[72815]:   </metadata>
Aug 17 19:57:44 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:57:44 user nova-compute[72815]:     <system>
Aug 17 19:57:44 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:57:44 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:57:44 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:57:44 user nova-compute[72815]:       <entry name="serial">1800ab7b-dd88-45fb-9370-1b77b8cbf893</entry>
Aug 17 19:57:44 user nova-compute[72815]:       <entry name="uuid">1800ab7b-dd88-45fb-9370-1b77b8cbf893</entry>
Aug 17 19:57:44 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:57:44 user nova-compute[72815]:     </system>
Aug 17 19:57:44 user nova-compute[72815]:   </sysinfo>
Aug 17 19:57:44 user nova-compute[72815]:   <os>
Aug 17 19:57:44 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:57:44 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:57:44 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:57:44 user nova-compute[72815]:   </os>
Aug 17 19:57:44 user nova-compute[72815]:   <features>
Aug 17 19:57:44 user nova-compute[72815]:     <acpi/>
Aug 17 19:57:44 user nova-compute[72815]:     <apic/>
Aug 17 19:57:44 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:57:44 user nova-compute[72815]:   </features>
Aug 17 19:57:44 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:57:44 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:57:44 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:57:44 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:57:44 user nova-compute[72815]:   </clock>
Aug 17 19:57:44 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:57:44 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:57:44 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:57:44 user nova-compute[72815]:   </cpu>
Aug 17 19:57:44 user nova-compute[72815]:   <devices>
Aug 17 19:57:44 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:57:44 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:57:44 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk"/>
Aug 17 19:57:44 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:57:44 user nova-compute[72815]:     </disk>
Aug 17 19:57:44 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 19:57:44 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:57:44 user nova-compute[72815]:       <source dev="/dev/sdb"/>
Aug 17 19:57:44 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 19:57:44 user nova-compute[72815]:       <serial>1c79b4ad-2ef9-42ee-8f37-aad0b223c4db</serial>
Aug 17 19:57:44 user nova-compute[72815]:     </disk>
Aug 17 19:57:44 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:57:44 user nova-compute[72815]:       <mac address="fa:16:3e:ef:cb:33"/>
Aug 17 19:57:44 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:57:44 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:57:44 user nova-compute[72815]:       <target dev="tap7d010d95-17"/>
Aug 17 19:57:44 user nova-compute[72815]:     </interface>
Aug 17 19:57:44 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:57:44 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/console.log" append="off"/>
Aug 17 19:57:44 user nova-compute[72815]:     </serial>
Aug 17 19:57:44 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:57:44 user nova-compute[72815]:     <video>
Aug 17 19:57:44 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:57:44 user nova-compute[72815]:     </video>
Aug 17 19:57:44 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:57:44 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:57:44 user nova-compute[72815]:     </rng>
Aug 17 19:57:44 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:57:44 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:57:44 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:57:44 user nova-compute[72815]:     </memballoon>
Aug 17 19:57:44 user nova-compute[72815]:   </devices>
Aug 17 19:57:44 user nova-compute[72815]: </domain>
Aug 17 19:57:44 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.178s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:57:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Cannot resize image /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'migration_context' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643279889',display_name='tempest-AttachVolumeTestJSON-server-643279889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643279889',id=5,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESF266QwfIKeTik8wnoygIiOf2r6BrCWxIIzDojrbBZKm/zXPBtL9YHLKhpKFS8eHXyHAtcWfIKVJD6LLHKDkJll+G0nOWdMGtF8im19Z7tm6u5x2HPboD1YjRBA8g36A==',key_name='tempest-keypair-447370262',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:53:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='fb016b8ab299475e9f916809c7b55182',ramdisk_id='',reservation_id='r-0ehl5jun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1462912324',owner_user_name='tempest-AttachVolumeTestJSON-1462912324-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:55:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c894534b34d943229dc89f6d58836acb',uuid=1800ab7b-dd88-45fb-9370-1b77b8cbf893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converting VIF {"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG os_vif [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d010d95-17, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d010d95-17, col_values=(('external_ids', {'iface-id': '7d010d95-173c-44df-be70-170e3ca59b0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:cb:33', 'vm-uuid': '1800ab7b-dd88-45fb-9370-1b77b8cbf893'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:45 user nova-compute[72815]: INFO os_vif [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17')
Aug 17 19:57:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-4a870a3b-c050-4389-ba93-1be6c4e5e7fc req-e38a62be-552c-4c15-a040-d9c820458e75 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4a870a3b-c050-4389-ba93-1be6c4e5e7fc req-e38a62be-552c-4c15-a040-d9c820458e75 service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4a870a3b-c050-4389-ba93-1be6c4e5e7fc req-e38a62be-552c-4c15-a040-d9c820458e75 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4a870a3b-c050-4389-ba93-1be6c4e5e7fc req-e38a62be-552c-4c15-a040-d9c820458e75 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-4a870a3b-c050-4389-ba93-1be6c4e5e7fc req-e38a62be-552c-4c15-a040-d9c820458e75 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:45 user nova-compute[72815]: WARNING nova.compute.manager [req-4a870a3b-c050-4389-ba93-1be6c4e5e7fc req-e38a62be-552c-4c15-a040-d9c820458e75 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state active and task_state rescuing.
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for 07d46763-1b59-4cce-9e10-e94d0efea05d due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302265.8826277, 07d46763-1b59-4cce-9e10-e94d0efea05d => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:57:45 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] VM Resumed (Lifecycle Event)
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-567e5194-e34b-4876-a1f9-6db65ba23ff0 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:57:45 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302265.8867767, 07d46763-1b59-4cce-9e10-e94d0efea05d => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:57:45 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] VM Started (Lifecycle Event)
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:57:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-ff95215b-cbc6-4667-97d1-de6741d94e1d req-1f230b62-b588-4250-bf79-2cd74493cf7a service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ff95215b-cbc6-4667-97d1-de6741d94e1d req-1f230b62-b588-4250-bf79-2cd74493cf7a service nova] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ff95215b-cbc6-4667-97d1-de6741d94e1d req-1f230b62-b588-4250-bf79-2cd74493cf7a service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ff95215b-cbc6-4667-97d1-de6741d94e1d req-1f230b62-b588-4250-bf79-2cd74493cf7a service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-ff95215b-cbc6-4667-97d1-de6741d94e1d req-1f230b62-b588-4250-bf79-2cd74493cf7a service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] No waiting events found dispatching network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:46 user nova-compute[72815]: WARNING nova.compute.manager [req-ff95215b-cbc6-4667-97d1-de6741d94e1d req-1f230b62-b588-4250-bf79-2cd74493cf7a service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received unexpected event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e for instance with vm_state stopped and task_state powering-on.
Aug 17 19:57:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-29d55ccd-a441-4ba1-9a60-7478f16b50f1 req-700ef392-11be-40e1-87c9-6b12f7cc80a8 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-29d55ccd-a441-4ba1-9a60-7478f16b50f1 req-700ef392-11be-40e1-87c9-6b12f7cc80a8 service nova] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-29d55ccd-a441-4ba1-9a60-7478f16b50f1 req-700ef392-11be-40e1-87c9-6b12f7cc80a8 service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-29d55ccd-a441-4ba1-9a60-7478f16b50f1 req-700ef392-11be-40e1-87c9-6b12f7cc80a8 service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-29d55ccd-a441-4ba1-9a60-7478f16b50f1 req-700ef392-11be-40e1-87c9-6b12f7cc80a8 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] No waiting events found dispatching network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:49 user nova-compute[72815]: WARNING nova.compute.manager [req-29d55ccd-a441-4ba1-9a60-7478f16b50f1 req-700ef392-11be-40e1-87c9-6b12f7cc80a8 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received unexpected event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e for instance with vm_state stopped and task_state powering-on.
Aug 17 19:57:49 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302269.0665565, 1800ab7b-dd88-45fb-9370-1b77b8cbf893 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:57:49 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] VM Resumed (Lifecycle Event)
Aug 17 19:57:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:57:49 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance rebooted successfully.
Aug 17 19:57:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6c7aed62-e7e1-4ca2-92e7-fc597f2a026d tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:57:49 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 19:57:49 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302269.0701942, 1800ab7b-dd88-45fb-9370-1b77b8cbf893 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:57:49 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] VM Started (Lifecycle Event)
Aug 17 19:57:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:57:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:57:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:55 user nova-compute[72815]: INFO nova.compute.manager [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Terminating instance
Aug 17 19:57:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-399fe565-5c37-4b6d-a5d4-1554a1c8218a req-3f4d8ca9-d979-4545-8782-7d4ff949a2d6 service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Received event network-vif-unplugged-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-399fe565-5c37-4b6d-a5d4-1554a1c8218a req-3f4d8ca9-d979-4545-8782-7d4ff949a2d6 service nova] Acquiring lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-399fe565-5c37-4b6d-a5d4-1554a1c8218a req-3f4d8ca9-d979-4545-8782-7d4ff949a2d6 service nova] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-399fe565-5c37-4b6d-a5d4-1554a1c8218a req-3f4d8ca9-d979-4545-8782-7d4ff949a2d6 service nova] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-399fe565-5c37-4b6d-a5d4-1554a1c8218a req-3f4d8ca9-d979-4545-8782-7d4ff949a2d6 service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] No waiting events found dispatching network-vif-unplugged-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-399fe565-5c37-4b6d-a5d4-1554a1c8218a req-3f4d8ca9-d979-4545-8782-7d4ff949a2d6 service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Received event network-vif-unplugged-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 19:57:56 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Instance destroyed successfully.
Aug 17 19:57:56 user nova-compute[72815]: DEBUG nova.objects.instance [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lazy-loading 'resources' on Instance uuid 01fdb794-dc6b-412b-95e1-c6c80cb81ecf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:57:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:54:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1079196209',display_name='tempest-TestVolumeSwap-server-1079196209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1079196209',id=10,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrWv8XNSJtYGW5uJQVDf4U0jk1TgdAw4LjANy0zBOV01q/9q/QotNSZt+u6E6cOmyxsiD7WBmpsixSlN2jwoLFEWcGeKkKecVFlP15lAvSyxd/jm8Fnfs5eUp9rKypvjg==',key_name='tempest-keypair-1060654525',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8d2bd59500f4ad39fdb1a3860452b05',ramdisk_id='',reservation_id='r-dfg31nth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-391106170',owner_user_name='tempest-TestVolumeSwap-391106170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:54:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6773e7e8a2dc47238fa39e488eaad3c6',uuid=01fdb794-dc6b-412b-95e1-c6c80cb81ecf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "address": "fa:16:3e:7d:d0:02", "network": {"id": "c99b980b-310e-49e8-8ac8-03448305c844", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1208402457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d2bd59500f4ad39fdb1a3860452b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa57b3e59-1c", "ovs_interfaceid": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:57:56 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Converting VIF {"id": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "address": "fa:16:3e:7d:d0:02", "network": {"id": "c99b980b-310e-49e8-8ac8-03448305c844", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1208402457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d2bd59500f4ad39fdb1a3860452b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa57b3e59-1c", "ovs_interfaceid": "a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:57:56 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d0:02,bridge_name='br-int',has_traffic_filtering=True,id=a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5,network=Network(c99b980b-310e-49e8-8ac8-03448305c844),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa57b3e59-1c') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:57:56 user nova-compute[72815]: DEBUG os_vif [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d0:02,bridge_name='br-int',has_traffic_filtering=True,id=a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5,network=Network(c99b980b-310e-49e8-8ac8-03448305c844),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa57b3e59-1c') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:57:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa57b3e59-1c, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:57:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:57:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:57:56 user nova-compute[72815]: INFO os_vif [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d0:02,bridge_name='br-int',has_traffic_filtering=True,id=a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5,network=Network(c99b980b-310e-49e8-8ac8-03448305c844),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa57b3e59-1c')
Aug 17 19:57:56 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Deleting instance files /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf_del
Aug 17 19:57:56 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Deletion of /opt/stack/data/nova/instances/01fdb794-dc6b-412b-95e1-c6c80cb81ecf_del complete
Aug 17 19:57:56 user nova-compute[72815]: INFO nova.compute.manager [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 17 19:57:56 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 19:57:56 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 19:57:56 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 19:57:57 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:57:57 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Took 1.16 seconds to deallocate network for instance.
Aug 17 19:57:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-b434575a-1bc6-4ec0-a70b-7c50fa75d7f5 req-9961cc4f-906d-4941-9b89-564af5922afd service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Received event network-vif-deleted-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:57 user nova-compute[72815]: INFO nova.compute.manager [req-b434575a-1bc6-4ec0-a70b-7c50fa75d7f5 req-9961cc4f-906d-4941-9b89-564af5922afd service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Neutron deleted interface a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5; detaching it from the instance and deleting it from the info cache
Aug 17 19:57:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-b434575a-1bc6-4ec0-a70b-7c50fa75d7f5 req-9961cc4f-906d-4941-9b89-564af5922afd service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:57:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-b434575a-1bc6-4ec0-a70b-7c50fa75d7f5 req-9961cc4f-906d-4941-9b89-564af5922afd service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Detach interface failed, port_id=a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5, reason: Instance 01fdb794-dc6b-412b-95e1-c6c80cb81ecf could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 19:57:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-0ea7b5ed-2c7c-47cd-81d9-f091ff47f9fd req-cd879fa9-d615-414a-9cd9-153f50f7da9a service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Received event network-vif-plugged-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:57:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0ea7b5ed-2c7c-47cd-81d9-f091ff47f9fd req-cd879fa9-d615-414a-9cd9-153f50f7da9a service nova] Acquiring lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:57:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0ea7b5ed-2c7c-47cd-81d9-f091ff47f9fd req-cd879fa9-d615-414a-9cd9-153f50f7da9a service nova] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:57:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0ea7b5ed-2c7c-47cd-81d9-f091ff47f9fd req-cd879fa9-d615-414a-9cd9-153f50f7da9a service nova] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-0ea7b5ed-2c7c-47cd-81d9-f091ff47f9fd req-cd879fa9-d615-414a-9cd9-153f50f7da9a service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] No waiting events found dispatching network-vif-plugged-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:57:57 user nova-compute[72815]: WARNING nova.compute.manager [req-0ea7b5ed-2c7c-47cd-81d9-f091ff47f9fd req-cd879fa9-d615-414a-9cd9-153f50f7da9a service nova] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Received unexpected event network-vif-plugged-a57b3e59-1ca3-4121-8fb8-ac1c331cb2b5 for instance with vm_state deleted and task_state None.
Aug 17 19:57:58 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:57:58 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:57:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:57:58 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Deleted allocations for instance 01fdb794-dc6b-412b-95e1-c6c80cb81ecf
Aug 17 19:57:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-64250be3-1b40-4fc0-aa97-c166f846c89b tempest-TestVolumeSwap-391106170 tempest-TestVolumeSwap-391106170-project-member] Lock "01fdb794-dc6b-412b-95e1-c6c80cb81ecf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.885s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-92a33a43-74d9-4b5e-b9c8-5db780337715 req-050124dc-71a2-4116-bd2d-8f20c95fe680 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Received event network-changed-14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-92a33a43-74d9-4b5e-b9c8-5db780337715 req-050124dc-71a2-4116-bd2d-8f20c95fe680 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Refreshing instance network info cache due to event network-changed-14230629-a60c-41b1-a7ba-bed70d03d123. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92a33a43-74d9-4b5e-b9c8-5db780337715 req-050124dc-71a2-4116-bd2d-8f20c95fe680 service nova] Acquiring lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92a33a43-74d9-4b5e-b9c8-5db780337715 req-050124dc-71a2-4116-bd2d-8f20c95fe680 service nova] Acquired lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG nova.network.neutron [req-92a33a43-74d9-4b5e-b9c8-5db780337715 req-050124dc-71a2-4116-bd2d-8f20c95fe680 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Refreshing network info cache for port 14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG nova.network.neutron [req-92a33a43-74d9-4b5e-b9c8-5db780337715 req-050124dc-71a2-4116-bd2d-8f20c95fe680 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Updated VIF entry in instance network info cache for port 14230629-a60c-41b1-a7ba-bed70d03d123. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG nova.network.neutron [req-92a33a43-74d9-4b5e-b9c8-5db780337715 req-050124dc-71a2-4116-bd2d-8f20c95fe680 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Updating instance_info_cache with network_info: [{"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92a33a43-74d9-4b5e-b9c8-5db780337715 req-050124dc-71a2-4116-bd2d-8f20c95fe680 service nova] Releasing lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "45b6365f-333f-45f1-b619-3453cbe75a88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "45b6365f-333f-45f1-b619-3453cbe75a88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG nova.objects.instance [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lazy-loading 'flavor' on Instance uuid 45b6365f-333f-45f1-b619-3453cbe75a88 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "45b6365f-333f-45f1-b619-3453cbe75a88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "45b6365f-333f-45f1-b619-3453cbe75a88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "45b6365f-333f-45f1-b619-3453cbe75a88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:01 user nova-compute[72815]: INFO nova.compute.manager [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Attaching volume 8c0bd2b9-1987-41cb-8a6e-52d5224154a6 to /dev/vdb
Aug 17 19:58:01 user nova-compute[72815]: DEBUG os_brick.utils [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ff406-5474-4aed-9c10-dd046c00c96f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c568eee-c8a7-41e9-bbf3-26e6e259ac57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2437f65-1b7c-46db-9df2-1b909bf0e102]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0990a451-2fb3-4373-9051-40371ac983d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:58:02 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:58:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a06b33e-b0d7-4b53-a553-a53747195513]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG os_brick.utils [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:58:02 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Updating existing volume attachment record: 6d071897-977a-4bde-a275-29112cff8284 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:58:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:11 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302276.3390682, 01fdb794-dc6b-412b-95e1-c6c80cb81ecf => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:58:11 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] VM Stopped (Lifecycle Event)
Aug 17 19:58:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-200edbb2-569f-45a0-b087-ab80a33f60fd None None] [instance: 01fdb794-dc6b-412b-95e1-c6c80cb81ecf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:58:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPBZcItx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:58:14 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:58:14 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:58:14 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[540ff218-6b61-4686-beca-62d541f04ea1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:58:14 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3421950-e174-471a-bb01-0238cebedd0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6] added
Aug 17 19:58:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e073af-cf7f-4dbe-82b9-7c5b6a904b1b]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[65daae70-dce8-45d9-b786-eed2ba2f0ef5]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OPBZcItx {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OPBZcItx" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[356816c3-eeec-451e-a5e0-5b512d4515be]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OPBZcItx'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca7b455-480c-454a-ab30-7d896d97ef94]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22da2fb-e144-4847-8955-529d928e4777]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:58:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:58:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaf62fb-3e8c-49fd-ba56-2e779192c26a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6, portal: 172.16.0.220,3260]
Aug 17 19:58:14 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6, portal: 172.16.0.220,3260] successful.
Aug 17 19:58:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65eb7a2-65bd-4c5f-87c9-8553405552bf]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d59fdf-8def-4959-b4d9-13ab8e979474]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 (non-flash)
Aug 17 19:58:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:58:14 user nova-compute[72815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 (non-flash)
Aug 17 19:58:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5720a80a-933a-45c8-843c-eab68f53eff6]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:58:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:58:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPBZcItx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:58:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:58:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23833613763366564', 'path': '/dev/sdf'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:58:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833613763366564', 'path': '/dev/sdf'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:58:15 user nova-compute[72815]: DEBUG nova.objects.instance [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lazy-loading 'flavor' on Instance uuid 45b6365f-333f-45f1-b619-3453cbe75a88 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:58:15 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:58:15 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 19:58:15 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:58:15 user nova-compute[72815]:   <serial>8c0bd2b9-1987-41cb-8a6e-52d5224154a6</serial>
Aug 17 19:58:15 user nova-compute[72815]: </disk>
Aug 17 19:58:15 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:58:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:58:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:58:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] No VIF found with MAC fa:16:3e:63:03:8c, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:58:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e5c62297-53a8-44a1-a397-8d9930a38fbf tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "45b6365f-333f-45f1-b619-3453cbe75a88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.580s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-1aab6738-581f-4105-a84b-ba2f0aa3371b req-6ecbed85-d747-4c1b-aba0-46801036c985 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-changed-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-1aab6738-581f-4105-a84b-ba2f0aa3371b req-6ecbed85-d747-4c1b-aba0-46801036c985 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Refreshing instance network info cache due to event network-changed-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:58:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1aab6738-581f-4105-a84b-ba2f0aa3371b req-6ecbed85-d747-4c1b-aba0-46801036c985 service nova] Acquiring lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:58:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1aab6738-581f-4105-a84b-ba2f0aa3371b req-6ecbed85-d747-4c1b-aba0-46801036c985 service nova] Acquired lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:58:16 user nova-compute[72815]: DEBUG nova.network.neutron [req-1aab6738-581f-4105-a84b-ba2f0aa3371b req-6ecbed85-d747-4c1b-aba0-46801036c985 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Refreshing network info cache for port 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:58:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:17 user nova-compute[72815]: DEBUG nova.network.neutron [req-1aab6738-581f-4105-a84b-ba2f0aa3371b req-6ecbed85-d747-4c1b-aba0-46801036c985 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updated VIF entry in instance network info cache for port 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:58:17 user nova-compute[72815]: DEBUG nova.network.neutron [req-1aab6738-581f-4105-a84b-ba2f0aa3371b req-6ecbed85-d747-4c1b-aba0-46801036c985 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updating instance_info_cache with network_info: [{"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:58:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1aab6738-581f-4105-a84b-ba2f0aa3371b req-6ecbed85-d747-4c1b-aba0-46801036c985 service nova] Releasing lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:58:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:17 user nova-compute[72815]: INFO nova.compute.manager [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Shelve offloading
Aug 17 19:58:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:18 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Instance destroyed successfully.
Aug 17 19:58:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:58:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:58:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquired lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:58:18 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "45b6365f-333f-45f1-b619-3453cbe75a88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "45b6365f-333f-45f1-b619-3453cbe75a88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:19 user nova-compute[72815]: INFO nova.compute.manager [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Detaching volume 8c0bd2b9-1987-41cb-8a6e-52d5224154a6
Aug 17 19:58:19 user nova-compute[72815]: INFO nova.virt.block_device [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Attempting to driver detach volume 8c0bd2b9-1987-41cb-8a6e-52d5224154a6 from mountpoint /dev/vdb
Aug 17 19:58:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Attempting to detach device vdb from instance 45b6365f-333f-45f1-b619-3453cbe75a88 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:58:19 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:58:19 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 19:58:19 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:58:19 user nova-compute[72815]:   <serial>8c0bd2b9-1987-41cb-8a6e-52d5224154a6</serial>
Aug 17 19:58:19 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:58:19 user nova-compute[72815]: </disk>
Aug 17 19:58:19 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:58:19 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Successfully detached device vdb from instance 45b6365f-333f-45f1-b619-3453cbe75a88 from the persistent domain config.
Aug 17 19:58:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45b6365f-333f-45f1-b619-3453cbe75a88 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:58:19 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:58:19 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 19:58:19 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:58:19 user nova-compute[72815]:   <serial>8c0bd2b9-1987-41cb-8a6e-52d5224154a6</serial>
Aug 17 19:58:19 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:58:19 user nova-compute[72815]: </disk>
Aug 17 19:58:19 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updating instance_info_cache with network_info: [{"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Releasing lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302299.8282368, 45b6365f-333f-45f1-b619-3453cbe75a88 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45b6365f-333f-45f1-b619-3453cbe75a88 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 19:58:19 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Successfully detached device vdb from instance 45b6365f-333f-45f1-b619-3453cbe75a88 from the live domain config.
Aug 17 19:58:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPBZcItx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:58:19 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:58:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7cac5c-b400-43f4-b438-c909c7be4747]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75b9e35-9d99-4dea-8b91-b0824b16acb9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:58:19 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:58:19 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:58:19 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:58:19 user nova-compute[72815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 (non-flash)
Aug 17 19:58:19 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:58:19 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:58:19 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:58:19 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:58:19 user nova-compute[72815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 (non-flash)
Aug 17 19:58:19 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944a6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6'): ({'sdf'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Removing single pathed devices sdf {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf76e617-8a11-4a2d-bc19-dda5f3071e58]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b62d647-7281-4be7-8a91-742c06d9e15d]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Flushing IO for device /dev/sdf {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:58:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d78843-05c8-42ea-8f0d-3f061b130551]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b84214b-4ad3-4928-8bf0-274fe09e7738]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf32e97-0388-4a3a-8b83-a3272ccfa513]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:20 user nova-compute[72815]: INFO nova.compute.manager [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Rescuing
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquired lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[987006ba-6d23-4afe-8dd9-26cf080428e3]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6, portal: 172.16.0.220,3260]
Aug 17 19:58:20 user nova-compute[72815]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6, portal: 172.16.0.220,3260] successful.
Aug 17 19:58:20 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0bd2b9-1987-41cb-8a6e-52d5224154a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af2213d-47fa-46d0-9b4c-e994545196ef]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] <== disconnect_volume: return (397ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:21 user nova-compute[72815]: DEBUG nova.objects.instance [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lazy-loading 'flavor' on Instance uuid 45b6365f-333f-45f1-b619-3453cbe75a88 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-011ed3ab-8096-4b55-b381-9377cf8f3c8a tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "45b6365f-333f-45f1-b619-3453cbe75a88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.383s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-f091a059-9a46-424a-88cf-75b67b5c946c req-3a00e52e-9ac5-44f9-a4d0-add46e1aef64 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-vif-unplugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f091a059-9a46-424a-88cf-75b67b5c946c req-3a00e52e-9ac5-44f9-a4d0-add46e1aef64 service nova] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f091a059-9a46-424a-88cf-75b67b5c946c req-3a00e52e-9ac5-44f9-a4d0-add46e1aef64 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f091a059-9a46-424a-88cf-75b67b5c946c req-3a00e52e-9ac5-44f9-a4d0-add46e1aef64 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-f091a059-9a46-424a-88cf-75b67b5c946c req-3a00e52e-9ac5-44f9-a4d0-add46e1aef64 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] No waiting events found dispatching network-vif-unplugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:58:21 user nova-compute[72815]: WARNING nova.compute.manager [req-f091a059-9a46-424a-88cf-75b67b5c946c req-3a00e52e-9ac5-44f9-a4d0-add46e1aef64 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received unexpected event network-vif-unplugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e for instance with vm_state active and task_state shelving.
Aug 17 19:58:22 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Instance destroyed successfully.
Aug 17 19:58:22 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lazy-loading 'resources' on Instance uuid 541f3b1c-207c-4398-ad60-ea50e89d7327 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1165123793',display_name='tempest-TestShelveInstance-server-1165123793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1165123793',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOi2xPAwcqfdBW30FDVnS7XjBIbIL9ATRk8TVn3fOxiyLSk4/uTwVf9Ch/4yM8vaqqysPYH5jrDs4Bynmf17N9AcOBKLdweEqV6EFE5jypDJSnnZUP0g2Tlwbgatsxlpw==',key_name='tempest-TestShelveInstance-1359395454',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e0a431d27ae4571bc0c8687e61c6fa2',ramdisk_id='',reservation_id='r-rvvq1591',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1622767385',owner_user_name='tempest-TestShelveInstance-1622767385-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:56:42Z,user_data=None,user_id='ce9def2151a447a68337ee04072fb748',uuid=541f3b1c-207c-4398-ad60-ea50e89d7327,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Converting VIF {"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_vif [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dfd3fe6-63, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Updating instance_info_cache with network_info: [{"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Releasing lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:22 user nova-compute[72815]: INFO os_vif [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63')
Aug 17 19:58:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQLHDUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:58:22 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b5dc52-d88e-480d-a19f-ada0fcb05cac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0518b9-5841-4a82-86ec-d45f97aeaca6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:58:22 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:58:22 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:58:22 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:58:22 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 19:58:22 user nova-compute[72815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:58:22 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:58:22 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:58:22 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944a6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74'): ({'sde'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Removing single pathed devices sde {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b79f79-d5b0-4f21-a632-71c653b9763e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66b39e1-8718-4aa9-96da-54388f5e4c19]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Flushing IO for device /dev/sde {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa45cefc-42bd-4f98-bfe0-a8729d46ca12]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73bf55b-738e-4a36-8658-0facc766306a]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7683e5f-cf41-4f1a-a8c0-71589f89dd02]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[64645159-581b-45c1-9873-dbcc024cd448]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260]
Aug 17 19:58:22 user nova-compute[72815]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260] successful.
Aug 17 19:58:22 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[64913582-d8e2-4135-89eb-9b9150c16c9f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] <== disconnect_volume: return (349ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:58:22 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Deleting instance files /opt/stack/data/nova/instances/541f3b1c-207c-4398-ad60-ea50e89d7327_del
Aug 17 19:58:22 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Deletion of /opt/stack/data/nova/instances/541f3b1c-207c-4398-ad60-ea50e89d7327_del complete
Aug 17 19:58:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:22 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:58:23 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Instance destroyed successfully.
Aug 17 19:58:23 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Attempting a stable device rescue
Aug 17 19:58:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72815) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 19:58:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Instance directory exists: not creating {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 19:58:23 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Creating image(s)
Aug 17 19:58:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "/opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "/opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.031s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:23 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'trusted_certs' on Instance uuid ac6faff5-9700-4504-81d8-8ba2ab64d85f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "e4ef065608bba0280f64bd92cf9909097f73a8eb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "e4ef065608bba0280f64bd92cf9909097f73a8eb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb.part --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-changed-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Refreshing instance network info cache due to event network-changed-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] Acquiring lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] Acquired lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG nova.network.neutron [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Refreshing network info cache for port 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:58:24 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Deleted allocations for instance 541f3b1c-207c-4398-ad60-ea50e89d7327
Aug 17 19:58:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lazy-loading 'numa_topology' on Instance uuid 541f3b1c-207c-4398-ad60-ea50e89d7327 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb.part --force-share --output=json" returned: 0 in 0.289s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG nova.virt.images [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] 47db0de6-bb84-4eb6-b1c2-a5312d68467d was qcow2, converting to raw {{(pid=72815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb.part /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb.converted {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:58:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb.part /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb.converted" returned: 0 in 0.223s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb.converted --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "e4ef065608bba0280f64bd92cf9909097f73a8eb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.817s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "e4ef065608bba0280f64bd92cf9909097f73a8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "e4ef065608bba0280f64bd92cf9909097f73a8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0a864949-a2e9-4374-9975-491fd24e6c21 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 7.814s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb,backing_fmt=raw /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.rescue {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb,backing_fmt=raw /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.rescue" returned: 0 in 0.062s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "e4ef065608bba0280f64bd92cf9909097f73a8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'migration_context' on Instance uuid ac6faff5-9700-4504-81d8-8ba2ab64d85f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Start _get_guest_xml network_info=[{"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "vif_mac": "fa:16:3e:0d:ba:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '47db0de6-bb84-4eb6-b1c2-a5312d68467d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '935728a7-77de-4f4d-9b8b-0086e8e1071e', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVceLKTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'ac6faff5-9700-4504-81d8-8ba2ab64d85f', 'attached_at': '', 'detached_at': '', 'volume_id': '6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e', 'serial': '6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'resources' on Instance uuid ac6faff5-9700-4504-81d8-8ba2ab64d85f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'numa_topology' on Instance uuid ac6faff5-9700-4504-81d8-8ba2ab64d85f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:25 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:58:25 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'vcpu_model' on Instance uuid ac6faff5-9700-4504-81d8-8ba2ab64d85f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVceLKTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:58:25 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:58:25 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:58:25 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[53703a9b-27c3-4b88-ba48-2b9c53262e20]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = iVceLKTw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 19:58:25 user nova-compute[72815]: node.name = iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e
Aug 17 19:58:25 user nova-compute[72815]: node.tpgt = -1
Aug 17 19:58:25 user nova-compute[72815]: node.startup = automatic
Aug 17 19:58:25 user nova-compute[72815]: node.leading_login = No
Aug 17 19:58:25 user nova-compute[72815]: iface.iscsi_ifacename = default
Aug 17 19:58:25 user nova-compute[72815]: iface.net_ifacename = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.ipaddress = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.prefix_len = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.hwaddress = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.transport_name = tcp
Aug 17 19:58:25 user nova-compute[72815]: iface.initiatorname = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.state = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.vlan_id = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.vlan_priority = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.vlan_state = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.iface_num = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.mtu = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.port = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.bootproto = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.subnet_mask = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.gateway = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.dhcp_alt_client_id = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.dhcp_dns = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.dhcp_learn_iqn = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.dhcp_vendor_id_state = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.dhcp_vendor_id = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.dhcp_slp_da = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.fragmentation = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.gratuitous_arp = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.incoming_forwarding = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.tos_state = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.tos = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.ttl = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.delayed_ack = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.tcp_nagle = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.tcp_wsf_state = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.tcp_wsf = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.tcp_timer_scale = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.tcp_timestamp = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.redirect = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.def_task_mgmt_timeout = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.header_digest = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.data_digest = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.immediate_data = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.initial_r2t = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.data_seq_inorder = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.data_pdu_inorder = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.erl = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.max_receive_data_len = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.first_burst_len = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.max_outstanding_r2t = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.max_burst_len = 0
Aug 17 19:58:25 user nova-compute[72815]: iface.chap_auth = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.bidi_chap = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.strict_login_compliance = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.discovery_auth = <empty>
Aug 17 19:58:25 user nova-compute[72815]: iface.discovery_logout = <empty>
Aug 17 19:58:25 user nova-compute[72815]: node.discovery_address = <empty>
Aug 17 19:58:25 user nova-compute[72815]: node.discovery_port = 0
Aug 17 19:58:25 user nova-compute[72815]: node.discovery_type = static
Aug 17 19:58:25 user nova-compute[72815]: node.session.initial_cmdsn = 0
Aug 17 19:58:25 user nova-compute[72815]: node.session.initial_login_retry_max = 8
Aug 17 19:58:25 user nova-compute[72815]: node.session.xmit_thread_priority = -20
Aug 17 19:58:25 user nova-compute[72815]: node.session.cmds_max = 128
Aug 17 19:58:25 user nova-compute[72815]: node.session.queue_depth = 32
Aug 17 19:58:25 user nova-compute[72815]: node.session.nr_sessions = 1
Aug 17 19:58:25 user nova-compute[72815]: node.session.auth.authmethod = CHAP
Aug 17 19:58:25 user nova-compute[72815]: node.session.auth.username = iVceLKTw
Aug 17 19:58:25 user nova-compute[72815]: node.session.auth.password = ***
Aug 17 19:58:25 user nova-compute[72815]: node.session.auth.username_in = <empty>
Aug 17 19:58:25 user nova-compute[72815]: node.session.auth.password_in = <empty>
Aug 17 19:58:25 user nova-compute[72815]: node.session.auth.chap_algs = MD5
Aug 17 19:58:25 user nova-compute[72815]: node.session.timeo.replacement_timeout = 120
Aug 17 19:58:25 user nova-compute[72815]: node.session.err_timeo.abort_timeout = 15
Aug 17 19:58:25 user nova-compute[72815]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 19:58:25 user nova-compute[72815]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 19:58:25 user nova-compute[72815]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 19:58:25 user nova-compute[72815]: node.session.iscsi.FastAbort = Yes
Aug 17 19:58:25 user nova-compute[72815]: node.session.iscsi.InitialR2T = No
Aug 17 19:58:25 user nova-compute[72815]: node.session.iscsi.ImmediateData = Yes
Aug 17 19:58:25 user nova-compute[72815]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 19:58:25 user nova-compute[72815]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 19:58:25 user nova-compute[72815]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 19:58:25 user nova-compute[72815]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 19:58:25 user nova-compute[72815]: node.session.iscsi.MaxConnections = 1
Aug 17 19:58:25 user nova-compute[72815]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 19:58:25 user nova-compute[72815]: node.session.iscsi.ERL = 0
Aug 17 19:58:25 user nova-compute[72815]: node.session.scan = manual
Aug 17 19:58:25 user nova-compute[72815]: node.session.reopen_max = 0
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].address = 172.16.0.220
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].port = 3260
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].startup = manual
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].tcp.window_size = 524288
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].tcp.type_of_service = 0
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].timeo.logout_timeout = 15
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].timeo.login_timeout = 15
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].timeo.auth_timeout = 45
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].iscsi.DataDigest = None
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].iscsi.IFMarker = No
Aug 17 19:58:25 user nova-compute[72815]: node.conn[0].iscsi.OFMarker = No
Aug 17 19:58:25 user nova-compute[72815]: # END RECORD
Aug 17 19:58:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[459a8317-49bc-4080-80e3-9fdc6e90650d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8139c1ea-3019-4f96-ac9b-f8fcdd3f1765]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVceLKTw {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVceLKTw" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[78233f5e-bde5-4f3b-b508-c36833571662]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iVceLKTw'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[257642c7-3bf5-468f-b4ba-8b205c51c5ae]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[df312927-ed36-4bc4-a30f-afeeca9e60dc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:58:25 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:58:25 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:58:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:58:25 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:58:25 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:58:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] HCTL ('34', '0', '0', 0) found on session 11 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[505f2299-dd32-49bf-a760-6c8f0766d94f]: (4, ('0 0 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching for a device in session 11 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVceLKTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.185s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] <== connect_volume: return (186ms) {'type': 'block', 'scsi_wwn': '26132653465326333', 'path': '/dev/sdc'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132653465326333', 'path': '/dev/sdc'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-686218442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-686218442',id=13,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-h68ujh5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:56:54Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=ac6faff5-9700-4504-81d8-8ba2ab64d85f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "vif_mac": "fa:16:3e:0d:ba:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "vif_mac": "fa:16:3e:0d:ba:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ba:21,bridge_name='br-int',has_traffic_filtering=True,id=682cf83c-ed24-401a-bdd4-7375f529aacb,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682cf83c-ed') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'pci_devices' on Instance uuid ac6faff5-9700-4504-81d8-8ba2ab64d85f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:58:25 user nova-compute[72815]:   <uuid>ac6faff5-9700-4504-81d8-8ba2ab64d85f</uuid>
Aug 17 19:58:25 user nova-compute[72815]:   <name>instance-0000000d</name>
Aug 17 19:58:25 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:58:25 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:58:25 user nova-compute[72815]:   <metadata>
Aug 17 19:58:25 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:58:25 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:58:25 user nova-compute[72815]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-686218442</nova:name>
Aug 17 19:58:25 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:58:25</nova:creationTime>
Aug 17 19:58:25 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:58:25 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:58:25 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:58:25 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:58:25 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:58:25 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:58:25 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:58:25 user nova-compute[72815]:       <nova:owner>
Aug 17 19:58:25 user nova-compute[72815]:         <nova:user uuid="169121564e514d4f883b71abeb3e6070">tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member</nova:user>
Aug 17 19:58:25 user nova-compute[72815]:         <nova:project uuid="89c20bd5232b4b058abc1b50f38cade3">tempest-ServerBootFromVolumeStableRescueTest-264619992</nova:project>
Aug 17 19:58:25 user nova-compute[72815]:       </nova:owner>
Aug 17 19:58:25 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:58:25 user nova-compute[72815]:       <nova:ports>
Aug 17 19:58:25 user nova-compute[72815]:         <nova:port uuid="682cf83c-ed24-401a-bdd4-7375f529aacb">
Aug 17 19:58:25 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 19:58:25 user nova-compute[72815]:         </nova:port>
Aug 17 19:58:25 user nova-compute[72815]:       </nova:ports>
Aug 17 19:58:25 user nova-compute[72815]:     </nova:instance>
Aug 17 19:58:25 user nova-compute[72815]:   </metadata>
Aug 17 19:58:25 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:58:25 user nova-compute[72815]:     <system>
Aug 17 19:58:25 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:58:25 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:58:25 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:58:25 user nova-compute[72815]:       <entry name="serial">ac6faff5-9700-4504-81d8-8ba2ab64d85f</entry>
Aug 17 19:58:25 user nova-compute[72815]:       <entry name="uuid">ac6faff5-9700-4504-81d8-8ba2ab64d85f</entry>
Aug 17 19:58:25 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:58:25 user nova-compute[72815]:     </system>
Aug 17 19:58:25 user nova-compute[72815]:   </sysinfo>
Aug 17 19:58:25 user nova-compute[72815]:   <os>
Aug 17 19:58:25 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:58:25 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:58:25 user nova-compute[72815]:   </os>
Aug 17 19:58:25 user nova-compute[72815]:   <features>
Aug 17 19:58:25 user nova-compute[72815]:     <acpi/>
Aug 17 19:58:25 user nova-compute[72815]:     <apic/>
Aug 17 19:58:25 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:58:25 user nova-compute[72815]:   </features>
Aug 17 19:58:25 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:58:25 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:58:25 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:58:25 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:58:25 user nova-compute[72815]:   </clock>
Aug 17 19:58:25 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:58:25 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:58:25 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:58:25 user nova-compute[72815]:   </cpu>
Aug 17 19:58:25 user nova-compute[72815]:   <devices>
Aug 17 19:58:25 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 19:58:25 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:58:25 user nova-compute[72815]:       <source dev="/dev/sdc"/>
Aug 17 19:58:25 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:58:25 user nova-compute[72815]:       <serial>6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e</serial>
Aug 17 19:58:25 user nova-compute[72815]:     </disk>
Aug 17 19:58:25 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:58:25 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:58:25 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.rescue"/>
Aug 17 19:58:25 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 19:58:25 user nova-compute[72815]:       <boot order="1"/>
Aug 17 19:58:25 user nova-compute[72815]:     </disk>
Aug 17 19:58:25 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:58:25 user nova-compute[72815]:       <mac address="fa:16:3e:0d:ba:21"/>
Aug 17 19:58:25 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:58:25 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:58:25 user nova-compute[72815]:       <target dev="tap682cf83c-ed"/>
Aug 17 19:58:25 user nova-compute[72815]:     </interface>
Aug 17 19:58:25 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:58:25 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/console.log" append="off"/>
Aug 17 19:58:25 user nova-compute[72815]:     </serial>
Aug 17 19:58:25 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:58:25 user nova-compute[72815]:     <video>
Aug 17 19:58:25 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:58:25 user nova-compute[72815]:     </video>
Aug 17 19:58:25 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:58:25 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:58:25 user nova-compute[72815]:     </rng>
Aug 17 19:58:25 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:58:25 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:58:25 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:58:25 user nova-compute[72815]:     </memballoon>
Aug 17 19:58:25 user nova-compute[72815]:   </devices>
Aug 17 19:58:25 user nova-compute[72815]: </domain>
Aug 17 19:58:25 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:58:25 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Instance destroyed successfully.
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No VIF found with MAC fa:16:3e:0d:ba:21, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.network.neutron [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updated VIF entry in instance network info cache for port 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.network.neutron [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updating instance_info_cache with network_info: [{"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": null, "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] Releasing lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:25 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] No waiting events found dispatching network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:58:25 user nova-compute[72815]: WARNING nova.compute.manager [req-3a367c50-fe6d-4ef4-89d0-fca93047d260 req-ca864bef-bd7b-475e-a2a0-a3e807e28909 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received unexpected event network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e for instance with vm_state active and task_state shelving.
Aug 17 19:58:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-b28d7bf0-30fa-4b63-ae05-8692ccfe95fd req-930ecc03-7b63-4de2-9c81-7828268942ff service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-unplugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b28d7bf0-30fa-4b63-ae05-8692ccfe95fd req-930ecc03-7b63-4de2-9c81-7828268942ff service nova] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b28d7bf0-30fa-4b63-ae05-8692ccfe95fd req-930ecc03-7b63-4de2-9c81-7828268942ff service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b28d7bf0-30fa-4b63-ae05-8692ccfe95fd req-930ecc03-7b63-4de2-9c81-7828268942ff service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-b28d7bf0-30fa-4b63-ae05-8692ccfe95fd req-930ecc03-7b63-4de2-9c81-7828268942ff service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] No waiting events found dispatching network-vif-unplugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:58:26 user nova-compute[72815]: WARNING nova.compute.manager [req-b28d7bf0-30fa-4b63-ae05-8692ccfe95fd req-930ecc03-7b63-4de2-9c81-7828268942ff service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received unexpected event network-vif-unplugged-682cf83c-ed24-401a-bdd4-7375f529aacb for instance with vm_state active and task_state rescuing.
Aug 17 19:58:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-9490d23f-7f59-44fc-b1d1-89a7175de681 req-80f9c62a-312f-4e54-b2f3-e27d82ee7303 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9490d23f-7f59-44fc-b1d1-89a7175de681 req-80f9c62a-312f-4e54-b2f3-e27d82ee7303 service nova] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9490d23f-7f59-44fc-b1d1-89a7175de681 req-80f9c62a-312f-4e54-b2f3-e27d82ee7303 service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9490d23f-7f59-44fc-b1d1-89a7175de681 req-80f9c62a-312f-4e54-b2f3-e27d82ee7303 service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-9490d23f-7f59-44fc-b1d1-89a7175de681 req-80f9c62a-312f-4e54-b2f3-e27d82ee7303 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] No waiting events found dispatching network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:58:28 user nova-compute[72815]: WARNING nova.compute.manager [req-9490d23f-7f59-44fc-b1d1-89a7175de681 req-80f9c62a-312f-4e54-b2f3-e27d82ee7303 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received unexpected event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb for instance with vm_state active and task_state rescuing.
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for ac6faff5-9700-4504-81d8-8ba2ab64d85f due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302309.5186477, ac6faff5-9700-4504-81d8-8ba2ab64d85f => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:58:29 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] VM Resumed (Lifecycle Event)
Aug 17 19:58:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a3a6f654-5c70-45c6-9768-431000826493 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302309.5291476, ac6faff5-9700-4504-81d8-8ba2ab64d85f => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:58:29 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] VM Started (Lifecycle Event)
Aug 17 19:58:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-45599da0-20f0-4734-85f0-a78b0212f9e2 req-681a9846-90b5-404b-86f3-6d7a48e80058 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-45599da0-20f0-4734-85f0-a78b0212f9e2 req-681a9846-90b5-404b-86f3-6d7a48e80058 service nova] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-45599da0-20f0-4734-85f0-a78b0212f9e2 req-681a9846-90b5-404b-86f3-6d7a48e80058 service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-45599da0-20f0-4734-85f0-a78b0212f9e2 req-681a9846-90b5-404b-86f3-6d7a48e80058 service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-45599da0-20f0-4734-85f0-a78b0212f9e2 req-681a9846-90b5-404b-86f3-6d7a48e80058 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] No waiting events found dispatching network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:58:30 user nova-compute[72815]: WARNING nova.compute.manager [req-45599da0-20f0-4734-85f0-a78b0212f9e2 req-681a9846-90b5-404b-86f3-6d7a48e80058 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received unexpected event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb for instance with vm_state rescued and task_state None.
Aug 17 19:58:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-45599da0-20f0-4734-85f0-a78b0212f9e2 req-681a9846-90b5-404b-86f3-6d7a48e80058 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-45599da0-20f0-4734-85f0-a78b0212f9e2 req-681a9846-90b5-404b-86f3-6d7a48e80058 service nova] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-45599da0-20f0-4734-85f0-a78b0212f9e2 req-681a9846-90b5-404b-86f3-6d7a48e80058 service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-45599da0-20f0-4734-85f0-a78b0212f9e2 req-681a9846-90b5-404b-86f3-6d7a48e80058 service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-45599da0-20f0-4734-85f0-a78b0212f9e2 req-681a9846-90b5-404b-86f3-6d7a48e80058 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] No waiting events found dispatching network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:58:30 user nova-compute[72815]: WARNING nova.compute.manager [req-45599da0-20f0-4734-85f0-a78b0212f9e2 req-681a9846-90b5-404b-86f3-6d7a48e80058 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received unexpected event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb for instance with vm_state rescued and task_state None.
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:58:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:33 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:58:33 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7176MB free_disk=25.526695251464844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 07d46763-1b59-4cce-9e10-e94d0efea05d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 969a1301-2014-4b22-8074-a0ac35136249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 45b6365f-333f-45f1-b619-3453cbe75a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 3a4f27f3-4573-43b5-827a-bbdae4ebce10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 82e60703-5060-446c-83c3-3b1c4c52abab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302298.2338083, 541f3b1c-207c-4398-ad60-ea50e89d7327 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:58:33 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] VM Stopped (Lifecycle Event)
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7f2601b6-e6fa-47fe-986a-544c9881186f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:58:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:34 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:58:34 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:58:34 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:58:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:58:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:58:34 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:58:35 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Updating instance_info_cache with network_info: [{"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:58:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:58:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:58:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:58:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:58:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:39 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:58:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:58:39 user nova-compute[72815]: INFO nova.compute.claims [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Claim successful on node user
Aug 17 19:58:40 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:58:40 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:58:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG nova.policy [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a82d9b206cf4499eaf518f7cd6a7a10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140294f17e4751b13e2d4a15b17ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:58:40 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Creating image(s)
Aug 17 19:58:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "/opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "/opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk 1073741824" returned: 0 in 0.064s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.197s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Cannot resize image /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'migration_context' on Instance uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Ensure instance console log exists: /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Successfully created port: b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:58:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:42 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Successfully updated port: b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:58:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:58:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquired lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:58:42 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:58:42 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:58:42 user nova-compute[72815]: DEBUG nova.compute.manager [req-d1e6586d-019f-4438-83d6-425c2c04f29c req-333c4c29-8165-44aa-b445-2a08e5f95a81 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-changed-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:42 user nova-compute[72815]: DEBUG nova.compute.manager [req-d1e6586d-019f-4438-83d6-425c2c04f29c req-333c4c29-8165-44aa-b445-2a08e5f95a81 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Refreshing instance network info cache due to event network-changed-b3639567-a71c-4a6c-81b5-0a04aa8800b2. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:58:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d1e6586d-019f-4438-83d6-425c2c04f29c req-333c4c29-8165-44aa-b445-2a08e5f95a81 service nova] Acquiring lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updating instance_info_cache with network_info: [{"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Releasing lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Instance network_info: |[{"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d1e6586d-019f-4438-83d6-425c2c04f29c req-333c4c29-8165-44aa-b445-2a08e5f95a81 service nova] Acquired lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.network.neutron [req-d1e6586d-019f-4438-83d6-425c2c04f29c req-333c4c29-8165-44aa-b445-2a08e5f95a81 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Refreshing network info cache for port b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Start _get_guest_xml network_info=[{"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:58:43 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:58:43 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1768421689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1768421689',id=17,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwq6B6YucI61a+XA6DcquTL6Maoiz9alX/+69B1C2l5COMq45Rjhb7PiVHLcsSjjclf89Dqbs4NMf3C5D0xYFGI7dTuolACUVlLGI/QtrqyveSxLlTXfFpvHMAvbRCo5w==',key_name='tempest-keypair-1366413119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa140294f17e4751b13e2d4a15b17ff9',ramdisk_id='',reservation_id='r-lho37lud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-632866040',owner_user_name='tempest-AttachVolumeShelveTestJSON-632866040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82d9b206cf4499eaf518f7cd6a7a10c',uuid=ee4a8248-9abc-45b3-9bf6-349c4d11f189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converting VIF {"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.objects.instance [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'pci_devices' on Instance uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:58:43 user nova-compute[72815]:   <uuid>ee4a8248-9abc-45b3-9bf6-349c4d11f189</uuid>
Aug 17 19:58:43 user nova-compute[72815]:   <name>instance-00000011</name>
Aug 17 19:58:43 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:58:43 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:58:43 user nova-compute[72815]:   <metadata>
Aug 17 19:58:43 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:58:43 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:58:43 user nova-compute[72815]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1768421689</nova:name>
Aug 17 19:58:43 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:58:43</nova:creationTime>
Aug 17 19:58:43 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:58:43 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:58:43 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:58:43 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:58:43 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:58:43 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:58:43 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:58:43 user nova-compute[72815]:       <nova:owner>
Aug 17 19:58:43 user nova-compute[72815]:         <nova:user uuid="a82d9b206cf4499eaf518f7cd6a7a10c">tempest-AttachVolumeShelveTestJSON-632866040-project-member</nova:user>
Aug 17 19:58:43 user nova-compute[72815]:         <nova:project uuid="aa140294f17e4751b13e2d4a15b17ff9">tempest-AttachVolumeShelveTestJSON-632866040</nova:project>
Aug 17 19:58:43 user nova-compute[72815]:       </nova:owner>
Aug 17 19:58:43 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:58:43 user nova-compute[72815]:       <nova:ports>
Aug 17 19:58:43 user nova-compute[72815]:         <nova:port uuid="b3639567-a71c-4a6c-81b5-0a04aa8800b2">
Aug 17 19:58:43 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 19:58:43 user nova-compute[72815]:         </nova:port>
Aug 17 19:58:43 user nova-compute[72815]:       </nova:ports>
Aug 17 19:58:43 user nova-compute[72815]:     </nova:instance>
Aug 17 19:58:43 user nova-compute[72815]:   </metadata>
Aug 17 19:58:43 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:58:43 user nova-compute[72815]:     <system>
Aug 17 19:58:43 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:58:43 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:58:43 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:58:43 user nova-compute[72815]:       <entry name="serial">ee4a8248-9abc-45b3-9bf6-349c4d11f189</entry>
Aug 17 19:58:43 user nova-compute[72815]:       <entry name="uuid">ee4a8248-9abc-45b3-9bf6-349c4d11f189</entry>
Aug 17 19:58:43 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:58:43 user nova-compute[72815]:     </system>
Aug 17 19:58:43 user nova-compute[72815]:   </sysinfo>
Aug 17 19:58:43 user nova-compute[72815]:   <os>
Aug 17 19:58:43 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:58:43 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:58:43 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:58:43 user nova-compute[72815]:   </os>
Aug 17 19:58:43 user nova-compute[72815]:   <features>
Aug 17 19:58:43 user nova-compute[72815]:     <acpi/>
Aug 17 19:58:43 user nova-compute[72815]:     <apic/>
Aug 17 19:58:43 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:58:43 user nova-compute[72815]:   </features>
Aug 17 19:58:43 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:58:43 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:58:43 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:58:43 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:58:43 user nova-compute[72815]:   </clock>
Aug 17 19:58:43 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:58:43 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:58:43 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:58:43 user nova-compute[72815]:   </cpu>
Aug 17 19:58:43 user nova-compute[72815]:   <devices>
Aug 17 19:58:43 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:58:43 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:58:43 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk"/>
Aug 17 19:58:43 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:58:43 user nova-compute[72815]:     </disk>
Aug 17 19:58:43 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:58:43 user nova-compute[72815]:       <mac address="fa:16:3e:4e:df:a1"/>
Aug 17 19:58:43 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:58:43 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:58:43 user nova-compute[72815]:       <target dev="tapb3639567-a7"/>
Aug 17 19:58:43 user nova-compute[72815]:     </interface>
Aug 17 19:58:43 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:58:43 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/console.log" append="off"/>
Aug 17 19:58:43 user nova-compute[72815]:     </serial>
Aug 17 19:58:43 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:58:43 user nova-compute[72815]:     <video>
Aug 17 19:58:43 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:58:43 user nova-compute[72815]:     </video>
Aug 17 19:58:43 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:58:43 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:58:43 user nova-compute[72815]:     </rng>
Aug 17 19:58:43 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:58:43 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:58:43 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:58:43 user nova-compute[72815]:     </memballoon>
Aug 17 19:58:43 user nova-compute[72815]:   </devices>
Aug 17 19:58:43 user nova-compute[72815]: </domain>
Aug 17 19:58:43 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1768421689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1768421689',id=17,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwq6B6YucI61a+XA6DcquTL6Maoiz9alX/+69B1C2l5COMq45Rjhb7PiVHLcsSjjclf89Dqbs4NMf3C5D0xYFGI7dTuolACUVlLGI/QtrqyveSxLlTXfFpvHMAvbRCo5w==',key_name='tempest-keypair-1366413119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa140294f17e4751b13e2d4a15b17ff9',ramdisk_id='',reservation_id='r-lho37lud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-632866040',owner_user_name='tempest-AttachVolumeShelveTestJSON-632866040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82d9b206cf4499eaf518f7cd6a7a10c',uuid=ee4a8248-9abc-45b3-9bf6-349c4d11f189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converting VIF {"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG os_vif [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3639567-a7, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3639567-a7, col_values=(('external_ids', {'iface-id': 'b3639567-a71c-4a6c-81b5-0a04aa8800b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:df:a1', 'vm-uuid': 'ee4a8248-9abc-45b3-9bf6-349c4d11f189'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:43 user nova-compute[72815]: INFO os_vif [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7')
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] No VIF found with MAC fa:16:3e:4e:df:a1, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-b0cfca16-4d18-4569-adf0-416695bdb189 req-20248510-3f92-4313-ae41-76aa7056ab4a service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-changed-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-b0cfca16-4d18-4569-adf0-416695bdb189 req-20248510-3f92-4313-ae41-76aa7056ab4a service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Refreshing instance network info cache due to event network-changed-e936e6d3-48e1-4322-b2d4-779037eff32c. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b0cfca16-4d18-4569-adf0-416695bdb189 req-20248510-3f92-4313-ae41-76aa7056ab4a service nova] Acquiring lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b0cfca16-4d18-4569-adf0-416695bdb189 req-20248510-3f92-4313-ae41-76aa7056ab4a service nova] Acquired lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:58:43 user nova-compute[72815]: DEBUG nova.network.neutron [req-b0cfca16-4d18-4569-adf0-416695bdb189 req-20248510-3f92-4313-ae41-76aa7056ab4a service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Refreshing network info cache for port e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:58:44 user nova-compute[72815]: DEBUG nova.network.neutron [req-d1e6586d-019f-4438-83d6-425c2c04f29c req-333c4c29-8165-44aa-b445-2a08e5f95a81 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updated VIF entry in instance network info cache for port b3639567-a71c-4a6c-81b5-0a04aa8800b2. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:58:44 user nova-compute[72815]: DEBUG nova.network.neutron [req-d1e6586d-019f-4438-83d6-425c2c04f29c req-333c4c29-8165-44aa-b445-2a08e5f95a81 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updating instance_info_cache with network_info: [{"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:58:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d1e6586d-019f-4438-83d6-425c2c04f29c req-333c4c29-8165-44aa-b445-2a08e5f95a81 service nova] Releasing lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:58:44 user nova-compute[72815]: DEBUG nova.network.neutron [req-b0cfca16-4d18-4569-adf0-416695bdb189 req-20248510-3f92-4313-ae41-76aa7056ab4a service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updated VIF entry in instance network info cache for port e936e6d3-48e1-4322-b2d4-779037eff32c. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:58:44 user nova-compute[72815]: DEBUG nova.network.neutron [req-b0cfca16-4d18-4569-adf0-416695bdb189 req-20248510-3f92-4313-ae41-76aa7056ab4a service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating instance_info_cache with network_info: [{"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:58:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b0cfca16-4d18-4569-adf0-416695bdb189 req-20248510-3f92-4313-ae41-76aa7056ab4a service nova] Releasing lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:58:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-326737e5-24ba-47af-9660-e86a12b1a48f req-656070e4-986d-4d62-bb83-82b5f6723e7c service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-326737e5-24ba-47af-9660-e86a12b1a48f req-656070e4-986d-4d62-bb83-82b5f6723e7c service nova] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-326737e5-24ba-47af-9660-e86a12b1a48f req-656070e4-986d-4d62-bb83-82b5f6723e7c service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-326737e5-24ba-47af-9660-e86a12b1a48f req-656070e4-986d-4d62-bb83-82b5f6723e7c service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-326737e5-24ba-47af-9660-e86a12b1a48f req-656070e4-986d-4d62-bb83-82b5f6723e7c service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] No waiting events found dispatching network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:58:45 user nova-compute[72815]: WARNING nova.compute.manager [req-326737e5-24ba-47af-9660-e86a12b1a48f req-656070e4-986d-4d62-bb83-82b5f6723e7c service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received unexpected event network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 for instance with vm_state building and task_state spawning.
Aug 17 19:58:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302327.1543703, ee4a8248-9abc-45b3-9bf6-349c4d11f189 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:58:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] VM Resumed (Lifecycle Event)
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:58:47 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Instance spawned successfully.
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:58:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302327.1595175, ee4a8248-9abc-45b3-9bf6-349c4d11f189 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:58:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] VM Started (Lifecycle Event)
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-2180ed4c-972c-4fab-ae12-fe453a295742 req-67e29c5a-51a2-4660-97e4-1cfb5f9567ee service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2180ed4c-972c-4fab-ae12-fe453a295742 req-67e29c5a-51a2-4660-97e4-1cfb5f9567ee service nova] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2180ed4c-972c-4fab-ae12-fe453a295742 req-67e29c5a-51a2-4660-97e4-1cfb5f9567ee service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2180ed4c-972c-4fab-ae12-fe453a295742 req-67e29c5a-51a2-4660-97e4-1cfb5f9567ee service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-2180ed4c-972c-4fab-ae12-fe453a295742 req-67e29c5a-51a2-4660-97e4-1cfb5f9567ee service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] No waiting events found dispatching network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:58:47 user nova-compute[72815]: WARNING nova.compute.manager [req-2180ed4c-972c-4fab-ae12-fe453a295742 req-67e29c5a-51a2-4660-97e4-1cfb5f9567ee service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received unexpected event network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 for instance with vm_state building and task_state spawning.
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:58:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:58:47 user nova-compute[72815]: INFO nova.compute.manager [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Took 6.62 seconds to spawn the instance on the hypervisor.
Aug 17 19:58:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:58:47 user nova-compute[72815]: INFO nova.compute.manager [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Took 7.59 seconds to build instance.
Aug 17 19:58:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a1617ad-c99e-49f9-88e8-92f10ed8d205 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.679s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:58:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:58:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:59:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:59:00 user nova-compute[72815]: INFO nova.compute.claims [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Claim successful on node user
Aug 17 19:59:00 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:59:00 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:59:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:59:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:59:00 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:59:00 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:59:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:59:01 user nova-compute[72815]: INFO nova.virt.block_device [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Booting with volume fa3094f0-c65a-4888-8928-93bd3dcc63fe at /dev/vda
Aug 17 19:59:01 user nova-compute[72815]: DEBUG os_brick.utils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG nova.policy [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '437d3bc2718d43d190e10a0c170cd889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f87cb80bdf4526972d9466d518b922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63194ad-38c1-473f-816e-20dba58ec520]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[68762589-8d2e-4c60-a9c7-91a3022903e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d1b70a-f0a8-4349-81f5-faec43087424]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf90493-432f-4bb4-a5cd-3e360070c150]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:59:01 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:59:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacd5b93-faed-4d23-b99a-e350138e3af0]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG os_brick.utils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:01 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating existing volume attachment record: 669fc3c3-6b95-43f2-8dd7-8f16407eff62 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:59:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Successfully created port: 431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:59:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Successfully created port: a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:59:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Successfully created port: 2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:59:05 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Successfully created port: c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:59:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:06 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Successfully created port: 55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "82e60703-5060-446c-83c3-3b1c4c52abab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "82e60703-5060-446c-83c3-3b1c4c52abab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:07 user nova-compute[72815]: INFO nova.compute.manager [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Terminating instance
Aug 17 19:59:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Successfully updated port: 431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-c662fadd-2568-4ac1-a497-81ff5b438246 req-8d1a7fad-e666-4dc6-997f-2cf388dd93e4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-changed-431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-c662fadd-2568-4ac1-a497-81ff5b438246 req-8d1a7fad-e666-4dc6-997f-2cf388dd93e4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing instance network info cache due to event network-changed-431a8b0e-fe6d-4805-9456-7a75a9cc7efe. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c662fadd-2568-4ac1-a497-81ff5b438246 req-8d1a7fad-e666-4dc6-997f-2cf388dd93e4 service nova] Acquiring lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c662fadd-2568-4ac1-a497-81ff5b438246 req-8d1a7fad-e666-4dc6-997f-2cf388dd93e4 service nova] Acquired lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG nova.network.neutron [req-c662fadd-2568-4ac1-a497-81ff5b438246 req-8d1a7fad-e666-4dc6-997f-2cf388dd93e4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing network info cache for port 431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:07 user nova-compute[72815]: DEBUG nova.network.neutron [req-c662fadd-2568-4ac1-a497-81ff5b438246 req-8d1a7fad-e666-4dc6-997f-2cf388dd93e4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:59:08 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Instance destroyed successfully.
Aug 17 19:59:08 user nova-compute[72815]: DEBUG nova.objects.instance [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lazy-loading 'resources' on Instance uuid 82e60703-5060-446c-83c3-3b1c4c52abab {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1200390700',display_name='tempest-VolumesAdminNegativeTest-server-1200390700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1200390700',id=15,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:57:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f619f5dec7704081974d9a757c392090',ramdisk_id='',reservation_id='r-wc5e0qgp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-380028141',owner_user_name='tempest-VolumesAdminNegativeTest-380028141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:57:12Z,user_data=None,user_id='5f92e9d1656b4677bc1539c279e60450',uuid=82e60703-5060-446c-83c3-3b1c4c52abab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd78781d-eff7-4100-8263-6717c622c4e4", "address": "fa:16:3e:a9:f6:28", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd78781d-ef", "ovs_interfaceid": "cd78781d-eff7-4100-8263-6717c622c4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Converting VIF {"id": "cd78781d-eff7-4100-8263-6717c622c4e4", "address": "fa:16:3e:a9:f6:28", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd78781d-ef", "ovs_interfaceid": "cd78781d-eff7-4100-8263-6717c622c4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f6:28,bridge_name='br-int',has_traffic_filtering=True,id=cd78781d-eff7-4100-8263-6717c622c4e4,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd78781d-ef') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG os_vif [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f6:28,bridge_name='br-int',has_traffic_filtering=True,id=cd78781d-eff7-4100-8263-6717c622c4e4,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd78781d-ef') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd78781d-ef, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:08 user nova-compute[72815]: INFO os_vif [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f6:28,bridge_name='br-int',has_traffic_filtering=True,id=cd78781d-eff7-4100-8263-6717c622c4e4,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd78781d-ef')
Aug 17 19:59:08 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Deleting instance files /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab_del
Aug 17 19:59:08 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Deletion of /opt/stack/data/nova/instances/82e60703-5060-446c-83c3-3b1c4c52abab_del complete
Aug 17 19:59:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-41608fad-5a33-4cb0-981a-1ed307a5a1ca req-50ab5e93-54ef-4181-b716-ab29a8f2f09f service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Received event network-vif-unplugged-cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-41608fad-5a33-4cb0-981a-1ed307a5a1ca req-50ab5e93-54ef-4181-b716-ab29a8f2f09f service nova] Acquiring lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-41608fad-5a33-4cb0-981a-1ed307a5a1ca req-50ab5e93-54ef-4181-b716-ab29a8f2f09f service nova] Lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-41608fad-5a33-4cb0-981a-1ed307a5a1ca req-50ab5e93-54ef-4181-b716-ab29a8f2f09f service nova] Lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-41608fad-5a33-4cb0-981a-1ed307a5a1ca req-50ab5e93-54ef-4181-b716-ab29a8f2f09f service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] No waiting events found dispatching network-vif-unplugged-cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-41608fad-5a33-4cb0-981a-1ed307a5a1ca req-50ab5e93-54ef-4181-b716-ab29a8f2f09f service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Received event network-vif-unplugged-cd78781d-eff7-4100-8263-6717c622c4e4 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 19:59:08 user nova-compute[72815]: INFO nova.compute.manager [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 17 19:59:08 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-c662fadd-2568-4ac1-a497-81ff5b438246 req-8d1a7fad-e666-4dc6-997f-2cf388dd93e4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c662fadd-2568-4ac1-a497-81ff5b438246 req-8d1a7fad-e666-4dc6-997f-2cf388dd93e4 service nova] Releasing lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:08 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:08 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Took 0.68 seconds to deallocate network for instance.
Aug 17 19:59:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-b2ba5d0c-d779-4b31-a8c7-bbf09e349adb req-b8836e8b-3010-429b-82b5-7e58b1b1f39c service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Received event network-vif-deleted-cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:09 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Successfully updated port: 2730732d-913e-4e70-b1ac-69acd53e9bac {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:59:09 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:59:09 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:59:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:09 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Deleted allocations for instance 82e60703-5060-446c-83c3-3b1c4c52abab
Aug 17 19:59:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96286109-63bc-46a0-a58c-f39026db4099 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "82e60703-5060-446c-83c3-3b1c4c52abab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.012s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-bc6e9fad-e537-48b8-9fbe-2e565127a6d8 req-9cad1883-0e3c-4cb4-97f6-a9df4b08cc1e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-changed-2730732d-913e-4e70-b1ac-69acd53e9bac {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-bc6e9fad-e537-48b8-9fbe-2e565127a6d8 req-9cad1883-0e3c-4cb4-97f6-a9df4b08cc1e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing instance network info cache due to event network-changed-2730732d-913e-4e70-b1ac-69acd53e9bac. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bc6e9fad-e537-48b8-9fbe-2e565127a6d8 req-9cad1883-0e3c-4cb4-97f6-a9df4b08cc1e service nova] Acquiring lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bc6e9fad-e537-48b8-9fbe-2e565127a6d8 req-9cad1883-0e3c-4cb4-97f6-a9df4b08cc1e service nova] Acquired lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:09 user nova-compute[72815]: DEBUG nova.network.neutron [req-bc6e9fad-e537-48b8-9fbe-2e565127a6d8 req-9cad1883-0e3c-4cb4-97f6-a9df4b08cc1e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing network info cache for port 2730732d-913e-4e70-b1ac-69acd53e9bac {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:09 user nova-compute[72815]: DEBUG nova.network.neutron [req-bc6e9fad-e537-48b8-9fbe-2e565127a6d8 req-9cad1883-0e3c-4cb4-97f6-a9df4b08cc1e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:59:10 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Successfully updated port: 8cb05478-e8f0-4130-9263-89b3b569bf41 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:59:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-b2abb30a-835f-4968-9b82-7ef252d9be0c req-fca143da-7ecd-4b7b-bbee-eb4803d69c2c service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Received event network-vif-plugged-cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b2abb30a-835f-4968-9b82-7ef252d9be0c req-fca143da-7ecd-4b7b-bbee-eb4803d69c2c service nova] Acquiring lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b2abb30a-835f-4968-9b82-7ef252d9be0c req-fca143da-7ecd-4b7b-bbee-eb4803d69c2c service nova] Lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b2abb30a-835f-4968-9b82-7ef252d9be0c req-fca143da-7ecd-4b7b-bbee-eb4803d69c2c service nova] Lock "82e60703-5060-446c-83c3-3b1c4c52abab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-b2abb30a-835f-4968-9b82-7ef252d9be0c req-fca143da-7ecd-4b7b-bbee-eb4803d69c2c service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] No waiting events found dispatching network-vif-plugged-cd78781d-eff7-4100-8263-6717c622c4e4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:10 user nova-compute[72815]: WARNING nova.compute.manager [req-b2abb30a-835f-4968-9b82-7ef252d9be0c req-fca143da-7ecd-4b7b-bbee-eb4803d69c2c service nova] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Received unexpected event network-vif-plugged-cd78781d-eff7-4100-8263-6717c622c4e4 for instance with vm_state deleted and task_state None.
Aug 17 19:59:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-bc6e9fad-e537-48b8-9fbe-2e565127a6d8 req-9cad1883-0e3c-4cb4-97f6-a9df4b08cc1e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bc6e9fad-e537-48b8-9fbe-2e565127a6d8 req-9cad1883-0e3c-4cb4-97f6-a9df4b08cc1e service nova] Releasing lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-a6250b85-3d2d-4b2f-bb1a-a501fe2413f3 req-e3f35f99-651a-4d8a-a331-26d6578ad4d1 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-changed-8cb05478-e8f0-4130-9263-89b3b569bf41 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-a6250b85-3d2d-4b2f-bb1a-a501fe2413f3 req-e3f35f99-651a-4d8a-a331-26d6578ad4d1 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing instance network info cache due to event network-changed-8cb05478-e8f0-4130-9263-89b3b569bf41. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a6250b85-3d2d-4b2f-bb1a-a501fe2413f3 req-e3f35f99-651a-4d8a-a331-26d6578ad4d1 service nova] Acquiring lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a6250b85-3d2d-4b2f-bb1a-a501fe2413f3 req-e3f35f99-651a-4d8a-a331-26d6578ad4d1 service nova] Acquired lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:11 user nova-compute[72815]: DEBUG nova.network.neutron [req-a6250b85-3d2d-4b2f-bb1a-a501fe2413f3 req-e3f35f99-651a-4d8a-a331-26d6578ad4d1 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing network info cache for port 8cb05478-e8f0-4130-9263-89b3b569bf41 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:11 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Successfully updated port: a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:59:12 user nova-compute[72815]: DEBUG nova.network.neutron [req-a6250b85-3d2d-4b2f-bb1a-a501fe2413f3 req-e3f35f99-651a-4d8a-a331-26d6578ad4d1 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:59:12 user nova-compute[72815]: DEBUG nova.network.neutron [req-a6250b85-3d2d-4b2f-bb1a-a501fe2413f3 req-e3f35f99-651a-4d8a-a331-26d6578ad4d1 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a6250b85-3d2d-4b2f-bb1a-a501fe2413f3 req-e3f35f99-651a-4d8a-a331-26d6578ad4d1 service nova] Releasing lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Successfully updated port: 2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-a7ac6c2e-9597-4b66-a9de-a6da64d8fb25 req-9e3606de-b2f7-4ac0-ab91-0a55de360c37 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received event network-changed-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-a7ac6c2e-9597-4b66-a9de-a6da64d8fb25 req-9e3606de-b2f7-4ac0-ab91-0a55de360c37 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Refreshing instance network info cache due to event network-changed-8efa8696-1a0f-42c7-a009-0700e77b8923. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a7ac6c2e-9597-4b66-a9de-a6da64d8fb25 req-9e3606de-b2f7-4ac0-ab91-0a55de360c37 service nova] Acquiring lock "refresh_cache-fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a7ac6c2e-9597-4b66-a9de-a6da64d8fb25 req-9e3606de-b2f7-4ac0-ab91-0a55de360c37 service nova] Acquired lock "refresh_cache-fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-a7ac6c2e-9597-4b66-a9de-a6da64d8fb25 req-9e3606de-b2f7-4ac0-ab91-0a55de360c37 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Refreshing network info cache for port 8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:13 user nova-compute[72815]: INFO nova.virt.block_device [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Booting with volume 7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae at /dev/vdb
Aug 17 19:59:13 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Successfully updated port: c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG os_brick.utils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8c7f9b-4846-469f-8d64-9ab550f6cc2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG nova.objects.instance [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'flavor' on Instance uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c28515-b92a-4fe0-8d05-e831da9962bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa36519f-fa3d-41a3-beca-c7db1ffd060e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-changed-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing instance network info cache due to event network-changed-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] Acquiring lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] Acquired lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing network info cache for port a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-a7ac6c2e-9597-4b66-a9de-a6da64d8fb25 req-9e3606de-b2f7-4ac0-ab91-0a55de360c37 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Updated VIF entry in instance network info cache for port 8efa8696-1a0f-42c7-a009-0700e77b8923. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-a7ac6c2e-9597-4b66-a9de-a6da64d8fb25 req-9e3606de-b2f7-4ac0-ab91-0a55de360c37 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Updating instance_info_cache with network_info: [{"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f092faa0-66d1-47a1-a574-45bb1cf07eb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a7ac6c2e-9597-4b66-a9de-a6da64d8fb25 req-9e3606de-b2f7-4ac0-ab91-0a55de360c37 service nova] Releasing lock "refresh_cache-fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:59:14 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a16f272-7e70-4be7-9936-e7f594111100]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG os_brick.utils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating existing volume attachment record: 93ecf03a-1925-4b6f-9a28-17c672e4a310 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.network.neutron [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:14 user nova-compute[72815]: INFO nova.compute.manager [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Attaching volume c500c537-a5a5-45c9-9d49-de565adcbbf0 to /dev/vdb
Aug 17 19:59:14 user nova-compute[72815]: DEBUG os_brick.utils [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca316d6-1192-42cc-b56b-81a098836836]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddec96c-f4f5-43aa-bf07-17fed031ff39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a441d2b6-e996-4fb8-afff-19e5922cacfa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5884ed9e-d201-4baf-9b31-fa65b5ef6b52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.network.neutron [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] Releasing lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.compute.manager [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-changed-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.compute.manager [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing instance network info cache due to event network-changed-2f92bde6-dd64-4c9c-b317-75cb5f984cc3. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] Acquiring lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] Acquired lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.network.neutron [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing network info cache for port 2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:59:14 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc32806-c7c8-4ce7-85e3-14c900205e82]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG os_brick.utils [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Updating existing volume attachment record: 8376d79f-0968-47b5-9303-335e468e54be {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.network.neutron [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.network.neutron [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] Releasing lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.compute.manager [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-changed-c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.compute.manager [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing instance network info cache due to event network-changed-c1ace327-2298-4cd7-b9ae-40656e87871b. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] Acquiring lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] Acquired lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.network.neutron [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing network info cache for port c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.network.neutron [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Successfully updated port: 55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:59:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:15 user nova-compute[72815]: DEBUG nova.network.neutron [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-92e4d9cc-7b56-4c59-aa70-6104bcdfc097 req-0f25905a-134e-430f-bd2d-b8fd60e8a401 service nova] Releasing lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquired lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:15 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:59:15 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:59:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-1c623439-9008-4633-8fb8-746e274def00 req-f1320555-3f10-4275-938d-062aa235a1e9 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-changed-55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-1c623439-9008-4633-8fb8-746e274def00 req-f1320555-3f10-4275-938d-062aa235a1e9 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing instance network info cache due to event network-changed-55be58dc-83ce-4144-b1f2-b18d8750e613. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1c623439-9008-4633-8fb8-746e274def00 req-f1320555-3f10-4275-938d-062aa235a1e9 service nova] Acquiring lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:17 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [{"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "address": "fa:16:3e:26:ef:49", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22dad22-87", "ovs_interfaceid": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1ace327-2298-4cd7-b9ae-40656e87871b", "address": "fa:16:3e:d7:d5:73", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace327-22", "ovs_interfaceid": "c1ace327-2298-4cd7-b9ae-40656e87871b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Releasing lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Instance network_info: |[{"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "address": "fa:16:3e:26:ef:49", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22dad22-87", "ovs_interfaceid": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1ace327-2298-4cd7-b9ae-40656e87871b", "address": "fa:16:3e:d7:d5:73", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace327-22", "ovs_interfaceid": "c1ace327-2298-4cd7-b9ae-40656e87871b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:59:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1c623439-9008-4633-8fb8-746e274def00 req-f1320555-3f10-4275-938d-062aa235a1e9 service nova] Acquired lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:18 user nova-compute[72815]: DEBUG nova.network.neutron [req-1c623439-9008-4633-8fb8-746e274def00 req-f1320555-3f10-4275-938d-062aa235a1e9 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing network info cache for port 55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:18 user nova-compute[72815]: DEBUG nova.network.neutron [req-1c623439-9008-4633-8fb8-746e274def00 req-f1320555-3f10-4275-938d-062aa235a1e9 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updated VIF entry in instance network info cache for port 55be58dc-83ce-4144-b1f2-b18d8750e613. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:59:18 user nova-compute[72815]: DEBUG nova.network.neutron [req-1c623439-9008-4633-8fb8-746e274def00 req-f1320555-3f10-4275-938d-062aa235a1e9 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [{"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "address": "fa:16:3e:26:ef:49", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22dad22-87", "ovs_interfaceid": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1ace327-2298-4cd7-b9ae-40656e87871b", "address": "fa:16:3e:d7:d5:73", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace327-22", "ovs_interfaceid": "c1ace327-2298-4cd7-b9ae-40656e87871b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1c623439-9008-4633-8fb8-746e274def00 req-f1320555-3f10-4275-938d-062aa235a1e9 service nova] Releasing lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:20 user nova-compute[72815]: INFO nova.compute.manager [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] instance snapshotting
Aug 17 19:59:21 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Beginning live snapshot process
Aug 17 19:59:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json -f qcow2 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json -f qcow2" returned: 0 in 0.228s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json -f qcow2 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json -f qcow2" returned: 0 in 0.250s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsev6sjr6/e803d74611314e2fb121693faebd9dc2.delta 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsev6sjr6/e803d74611314e2fb121693faebd9dc2.delta 1073741824" returned: 0 in 0.051s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:21 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 19:59:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:59:23 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302348.1411083, 82e60703-5060-446c-83c3-3b1c4c52abab => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:23 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] VM Stopped (Lifecycle Event)
Aug 17 19:59:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-b235266d-6f48-4dae-b9af-71ecbd101945 None None] [instance: 82e60703-5060-446c-83c3-3b1c4c52abab] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 19:59:23 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 19:59:23 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 19:59:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsev6sjr6/e803d74611314e2fb121693faebd9dc2.delta /opt/stack/data/nova/instances/snapshots/tmpsev6sjr6/e803d74611314e2fb121693faebd9dc2 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsev6sjr6/e803d74611314e2fb121693faebd9dc2.delta /opt/stack/data/nova/instances/snapshots/tmpsev6sjr6/e803d74611314e2fb121693faebd9dc2" returned: 0 in 0.605s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:24 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Snapshot extracted, beginning image upload
Aug 17 19:59:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:24 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:59:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:59:24 user nova-compute[72815]: INFO nova.compute.claims [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Claim successful on node user
Aug 17 19:59:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:59:25 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:59:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG nova.policy [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa27c69e40f243d9b38c87250b5dba5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6d2cf2910f4d3d9924480d68057b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:59:25 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Creating image(s)
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "/opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "/opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:59:25 user nova-compute[72815]: INFO nova.compute.claims [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Claim successful on node user
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.199s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk 1073741824" returned: 0 in 0.059s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.317s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Successfully created port: 7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Cannot resize image /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'migration_context' on Instance uuid dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Ensure instance console log exists: /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.977s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.477s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:59:26 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.policy [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa27c69e40f243d9b38c87250b5dba5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6d2cf2910f4d3d9924480d68057b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:59:26 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Creating image(s)
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "/opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "/opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:26 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Snapshot image upload complete
Aug 17 19:59:26 user nova-compute[72815]: INFO nova.compute.manager [None req-85f3987d-6c87-43f3-a84b-b9ad3b8871cd tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Took 5.92 seconds to snapshot the instance on the hypervisor.
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.214s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk 1073741824" returned: 0 in 0.059s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Successfully updated port: 7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.compute.manager [req-7ffed41e-17f9-4368-9b95-dfaf1c1a5801 req-cadb217d-56c6-4288-8d2e-d271a6180b6e service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-changed-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.compute.manager [req-7ffed41e-17f9-4368-9b95-dfaf1c1a5801 req-cadb217d-56c6-4288-8d2e-d271a6180b6e service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Refreshing instance network info cache due to event network-changed-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7ffed41e-17f9-4368-9b95-dfaf1c1a5801 req-cadb217d-56c6-4288-8d2e-d271a6180b6e service nova] Acquiring lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7ffed41e-17f9-4368-9b95-dfaf1c1a5801 req-cadb217d-56c6-4288-8d2e-d271a6180b6e service nova] Acquired lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.network.neutron [req-7ffed41e-17f9-4368-9b95-dfaf1c1a5801 req-cadb217d-56c6-4288-8d2e-d271a6180b6e service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Refreshing network info cache for port 7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Successfully created port: 5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.213s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.network.neutron [req-7ffed41e-17f9-4368-9b95-dfaf1c1a5801 req-cadb217d-56c6-4288-8d2e-d271a6180b6e service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:59:27 user nova-compute[72815]: INFO nova.virt.block_device [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Booting with volume 443cbc27-a597-4636-8ae6-31f8cc49009d at /dev/vdc
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRdiENpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:27 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:27 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:27 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9ec256-8cce-4f59-9743-d305981df796]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:59:27 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.utils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9867f47-5dab-42a6-82ed-eede0539f8e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0] added
Aug 17 19:59:27 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a978a4-1b48-46e7-81a5-73a54fb424b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Cannot resize image /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'migration_context' on Instance uuid ec0afde2-8d2b-451a-a226-be933e28ad6f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9093b241-31ce-4399-8612-39ac9c6e12d0]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d94b5ef-c057-4cbb-886b-9efbea5d5283]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Ensure instance console log exists: /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2327a90-0869-4e74-ab93-e5aef24e73af]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9310c3-4db3-4196-979e-8ed0c2a505cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRdiENpD {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[514d798a-84bb-43a3-9a09-92ccd5fdb274]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRdiENpD" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d9ccaf-3302-4630-8b9f-c91dbbc73d5e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YRdiENpD'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.network.neutron [req-7ffed41e-17f9-4368-9b95-dfaf1c1a5801 req-cadb217d-56c6-4288-8d2e-d271a6180b6e service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:59:27 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2107fbe-29fb-43f6-8e4d-fde06ee697ab]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0be29fd-5fea-43e5-b598-69dc79dbe4bf]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.utils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] <== get_connector_properties: return (208ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating existing volume attachment record: a92f4e18-4296-474b-81b4-f2569159cc7d {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7ffed41e-17f9-4368-9b95-dfaf1c1a5801 req-cadb217d-56c6-4288-8d2e-d271a6180b6e service nova] Releasing lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquired lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3291e01-2745-42b6-ace9-e7aec07ffc5f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:27 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:27 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:59:27 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:27 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:27 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:59:27 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e98cff4-cac6-402e-bbe1-43c2e0866ca0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260]
Aug 17 19:59:27 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260] successful.
Aug 17 19:59:27 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c040fa8f-1a77-4eaf-a4fa-46403aad9e40]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a280a8-996a-4b46-8226-8757157eb50a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:28 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:28 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:59:28 user nova-compute[72815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 19:59:28 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:28 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:28 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:59:28 user nova-compute[72815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 19:59:28 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.539s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9479616b-ebb2-4741-b9d7-162923f7f811]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRdiENpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Updating instance_info_cache with network_info: [{"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Releasing lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Instance network_info: |[{"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Start _get_guest_xml network_info=[{"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:28 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:59:28 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-999185640',display_name='tempest-ServerRescueNegativeTestJSON-server-999185640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-999185640',id=19,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6d2cf2910f4d3d9924480d68057b5a',ramdisk_id='',reservation_id='r-srtg51rj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-335799606',owner_user_name='tempest-ServerRescueNegativeTestJSON-335799606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:25Z,user_data=None,user_id='fa27c69e40f243d9b38c87250b5dba5f',uuid=dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converting VIF {"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:78:60,bridge_name='br-int',has_traffic_filtering=True,id=7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7d0039-07') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'pci_devices' on Instance uuid dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:59:28 user nova-compute[72815]:   <uuid>dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2</uuid>
Aug 17 19:59:28 user nova-compute[72815]:   <name>instance-00000013</name>
Aug 17 19:59:28 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:59:28 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:59:28 user nova-compute[72815]:   <metadata>
Aug 17 19:59:28 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:59:28 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:59:28 user nova-compute[72815]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-999185640</nova:name>
Aug 17 19:59:28 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:59:28</nova:creationTime>
Aug 17 19:59:28 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:59:28 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:59:28 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:59:28 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:59:28 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:59:28 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:59:28 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:59:28 user nova-compute[72815]:       <nova:owner>
Aug 17 19:59:28 user nova-compute[72815]:         <nova:user uuid="fa27c69e40f243d9b38c87250b5dba5f">tempest-ServerRescueNegativeTestJSON-335799606-project-member</nova:user>
Aug 17 19:59:28 user nova-compute[72815]:         <nova:project uuid="4e6d2cf2910f4d3d9924480d68057b5a">tempest-ServerRescueNegativeTestJSON-335799606</nova:project>
Aug 17 19:59:28 user nova-compute[72815]:       </nova:owner>
Aug 17 19:59:28 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:59:28 user nova-compute[72815]:       <nova:ports>
Aug 17 19:59:28 user nova-compute[72815]:         <nova:port uuid="7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe">
Aug 17 19:59:28 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 19:59:28 user nova-compute[72815]:         </nova:port>
Aug 17 19:59:28 user nova-compute[72815]:       </nova:ports>
Aug 17 19:59:28 user nova-compute[72815]:     </nova:instance>
Aug 17 19:59:28 user nova-compute[72815]:   </metadata>
Aug 17 19:59:28 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:59:28 user nova-compute[72815]:     <system>
Aug 17 19:59:28 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:59:28 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:59:28 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:59:28 user nova-compute[72815]:       <entry name="serial">dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2</entry>
Aug 17 19:59:28 user nova-compute[72815]:       <entry name="uuid">dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2</entry>
Aug 17 19:59:28 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:59:28 user nova-compute[72815]:     </system>
Aug 17 19:59:28 user nova-compute[72815]:   </sysinfo>
Aug 17 19:59:28 user nova-compute[72815]:   <os>
Aug 17 19:59:28 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:59:28 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:59:28 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:59:28 user nova-compute[72815]:   </os>
Aug 17 19:59:28 user nova-compute[72815]:   <features>
Aug 17 19:59:28 user nova-compute[72815]:     <acpi/>
Aug 17 19:59:28 user nova-compute[72815]:     <apic/>
Aug 17 19:59:28 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:59:28 user nova-compute[72815]:   </features>
Aug 17 19:59:28 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:59:28 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:59:28 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:59:28 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:59:28 user nova-compute[72815]:   </clock>
Aug 17 19:59:28 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:59:28 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:59:28 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:59:28 user nova-compute[72815]:   </cpu>
Aug 17 19:59:28 user nova-compute[72815]:   <devices>
Aug 17 19:59:28 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:59:28 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:59:28 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk"/>
Aug 17 19:59:28 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:59:28 user nova-compute[72815]:     </disk>
Aug 17 19:59:28 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:59:28 user nova-compute[72815]:       <mac address="fa:16:3e:89:78:60"/>
Aug 17 19:59:28 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:28 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:59:28 user nova-compute[72815]:       <target dev="tap7f7d0039-07"/>
Aug 17 19:59:28 user nova-compute[72815]:     </interface>
Aug 17 19:59:28 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:59:28 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/console.log" append="off"/>
Aug 17 19:59:28 user nova-compute[72815]:     </serial>
Aug 17 19:59:28 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:59:28 user nova-compute[72815]:     <video>
Aug 17 19:59:28 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:28 user nova-compute[72815]:     </video>
Aug 17 19:59:28 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:59:28 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:59:28 user nova-compute[72815]:     </rng>
Aug 17 19:59:28 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:59:28 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:59:28 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:59:28 user nova-compute[72815]:     </memballoon>
Aug 17 19:59:28 user nova-compute[72815]:   </devices>
Aug 17 19:59:28 user nova-compute[72815]: </domain>
Aug 17 19:59:28 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-999185640',display_name='tempest-ServerRescueNegativeTestJSON-server-999185640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-999185640',id=19,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6d2cf2910f4d3d9924480d68057b5a',ramdisk_id='',reservation_id='r-srtg51rj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-335799606',owner_user_name='tempest-ServerRescueNegativeTestJSON-335799606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:25Z,user_data=None,user_id='fa27c69e40f243d9b38c87250b5dba5f',uuid=dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converting VIF {"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:78:60,bridge_name='br-int',has_traffic_filtering=True,id=7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7d0039-07') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG os_vif [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:78:60,bridge_name='br-int',has_traffic_filtering=True,id=7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7d0039-07') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f7d0039-07, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f7d0039-07, col_values=(('external_ids', {'iface-id': '7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:78:60', 'vm-uuid': 'dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:28 user nova-compute[72815]: INFO os_vif [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:78:60,bridge_name='br-int',has_traffic_filtering=True,id=7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7d0039-07')
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No VIF found with MAC fa:16:3e:89:78:60, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Successfully updated port: 5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquired lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.compute.manager [req-28fc40e1-c559-4ffc-a564-709e43cb36cd req-f68587c9-75bf-4cc8-9567-df7d3c05cd26 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received event network-changed-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.compute.manager [req-28fc40e1-c559-4ffc-a564-709e43cb36cd req-f68587c9-75bf-4cc8-9567-df7d3c05cd26 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Refreshing instance network info cache due to event network-changed-5c1dfe2e-5dea-442a-b69a-8ac17c027541. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-28fc40e1-c559-4ffc-a564-709e43cb36cd req-f68587c9-75bf-4cc8-9567-df7d3c05cd26 service nova] Acquiring lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.585s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== connect_volume: return (1586ms) {'type': 'block', 'scsi_wwn': '26263643636353862', 'path': '/dev/sde'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263643636353862', 'path': '/dev/sde'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.objects.instance [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'flavor' on Instance uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:59:29 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:59:29 user nova-compute[72815]:   <source dev="/dev/sde"/>
Aug 17 19:59:29 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:59:29 user nova-compute[72815]:   <serial>c500c537-a5a5-45c9-9d49-de565adcbbf0</serial>
Aug 17 19:59:29 user nova-compute[72815]: </disk>
Aug 17 19:59:29 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:29 user nova-compute[72815]: INFO nova.compute.manager [None req-673e8349-a567-423d-a463-bc5bc03f173f tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Unrescuing
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-673e8349-a567-423d-a463-bc5bc03f173f tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-673e8349-a567-423d-a463-bc5bc03f173f tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquired lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.network.neutron [None req-673e8349-a567-423d-a463-bc5bc03f173f tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Updating instance_info_cache with network_info: [{"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Releasing lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Instance network_info: |[{"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-28fc40e1-c559-4ffc-a564-709e43cb36cd req-f68587c9-75bf-4cc8-9567-df7d3c05cd26 service nova] Acquired lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.network.neutron [req-28fc40e1-c559-4ffc-a564-709e43cb36cd req-f68587c9-75bf-4cc8-9567-df7d3c05cd26 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Refreshing network info cache for port 5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Start _get_guest_xml network_info=[{"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:59:29 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:59:29 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1153727331',display_name='tempest-ServerRescueNegativeTestJSON-server-1153727331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1153727331',id=20,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6d2cf2910f4d3d9924480d68057b5a',ramdisk_id='',reservation_id='r-z9z0cph6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-335799606',owner_user_name='tempest-ServerRescueNegativeTestJSON-335799606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:27Z,user_data=None,user_id='fa27c69e40f243d9b38c87250b5dba5f',uuid=ec0afde2-8d2b-451a-a226-be933e28ad6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converting VIF {"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:69:15,bridge_name='br-int',has_traffic_filtering=True,id=5c1dfe2e-5dea-442a-b69a-8ac17c027541,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1dfe2e-5d') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'pci_devices' on Instance uuid ec0afde2-8d2b-451a-a226-be933e28ad6f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:59:29 user nova-compute[72815]:   <uuid>ec0afde2-8d2b-451a-a226-be933e28ad6f</uuid>
Aug 17 19:59:29 user nova-compute[72815]:   <name>instance-00000014</name>
Aug 17 19:59:29 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:59:29 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:59:29 user nova-compute[72815]:   <metadata>
Aug 17 19:59:29 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:59:29 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:59:29 user nova-compute[72815]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1153727331</nova:name>
Aug 17 19:59:29 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:59:29</nova:creationTime>
Aug 17 19:59:29 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:59:29 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:59:29 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:59:29 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:59:29 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:59:29 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:59:29 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:59:29 user nova-compute[72815]:       <nova:owner>
Aug 17 19:59:29 user nova-compute[72815]:         <nova:user uuid="fa27c69e40f243d9b38c87250b5dba5f">tempest-ServerRescueNegativeTestJSON-335799606-project-member</nova:user>
Aug 17 19:59:29 user nova-compute[72815]:         <nova:project uuid="4e6d2cf2910f4d3d9924480d68057b5a">tempest-ServerRescueNegativeTestJSON-335799606</nova:project>
Aug 17 19:59:29 user nova-compute[72815]:       </nova:owner>
Aug 17 19:59:29 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:59:29 user nova-compute[72815]:       <nova:ports>
Aug 17 19:59:29 user nova-compute[72815]:         <nova:port uuid="5c1dfe2e-5dea-442a-b69a-8ac17c027541">
Aug 17 19:59:29 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 19:59:29 user nova-compute[72815]:         </nova:port>
Aug 17 19:59:29 user nova-compute[72815]:       </nova:ports>
Aug 17 19:59:29 user nova-compute[72815]:     </nova:instance>
Aug 17 19:59:29 user nova-compute[72815]:   </metadata>
Aug 17 19:59:29 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:59:29 user nova-compute[72815]:     <system>
Aug 17 19:59:29 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:59:29 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:59:29 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:59:29 user nova-compute[72815]:       <entry name="serial">ec0afde2-8d2b-451a-a226-be933e28ad6f</entry>
Aug 17 19:59:29 user nova-compute[72815]:       <entry name="uuid">ec0afde2-8d2b-451a-a226-be933e28ad6f</entry>
Aug 17 19:59:29 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:59:29 user nova-compute[72815]:     </system>
Aug 17 19:59:29 user nova-compute[72815]:   </sysinfo>
Aug 17 19:59:29 user nova-compute[72815]:   <os>
Aug 17 19:59:29 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:59:29 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:59:29 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:59:29 user nova-compute[72815]:   </os>
Aug 17 19:59:29 user nova-compute[72815]:   <features>
Aug 17 19:59:29 user nova-compute[72815]:     <acpi/>
Aug 17 19:59:29 user nova-compute[72815]:     <apic/>
Aug 17 19:59:29 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:59:29 user nova-compute[72815]:   </features>
Aug 17 19:59:29 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:59:29 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:59:29 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:59:29 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:59:29 user nova-compute[72815]:   </clock>
Aug 17 19:59:29 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:59:29 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:59:29 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:59:29 user nova-compute[72815]:   </cpu>
Aug 17 19:59:29 user nova-compute[72815]:   <devices>
Aug 17 19:59:29 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:59:29 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:59:29 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk"/>
Aug 17 19:59:29 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:59:29 user nova-compute[72815]:     </disk>
Aug 17 19:59:29 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:59:29 user nova-compute[72815]:       <mac address="fa:16:3e:2f:69:15"/>
Aug 17 19:59:29 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:29 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:59:29 user nova-compute[72815]:       <target dev="tap5c1dfe2e-5d"/>
Aug 17 19:59:29 user nova-compute[72815]:     </interface>
Aug 17 19:59:29 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:59:29 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/console.log" append="off"/>
Aug 17 19:59:29 user nova-compute[72815]:     </serial>
Aug 17 19:59:29 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:59:29 user nova-compute[72815]:     <video>
Aug 17 19:59:29 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:29 user nova-compute[72815]:     </video>
Aug 17 19:59:29 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:59:29 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:59:29 user nova-compute[72815]:     </rng>
Aug 17 19:59:29 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:59:29 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:59:29 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:59:29 user nova-compute[72815]:     </memballoon>
Aug 17 19:59:29 user nova-compute[72815]:   </devices>
Aug 17 19:59:29 user nova-compute[72815]: </domain>
Aug 17 19:59:29 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1153727331',display_name='tempest-ServerRescueNegativeTestJSON-server-1153727331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1153727331',id=20,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6d2cf2910f4d3d9924480d68057b5a',ramdisk_id='',reservation_id='r-z9z0cph6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-335799606',owner_user_name='tempest-ServerRescueNegativeTestJSON-335799606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:27Z,user_data=None,user_id='fa27c69e40f243d9b38c87250b5dba5f',uuid=ec0afde2-8d2b-451a-a226-be933e28ad6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converting VIF {"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:69:15,bridge_name='br-int',has_traffic_filtering=True,id=5c1dfe2e-5dea-442a-b69a-8ac17c027541,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1dfe2e-5d') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG os_vif [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:69:15,bridge_name='br-int',has_traffic_filtering=True,id=5c1dfe2e-5dea-442a-b69a-8ac17c027541,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1dfe2e-5d') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c1dfe2e-5d, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c1dfe2e-5d, col_values=(('external_ids', {'iface-id': '5c1dfe2e-5dea-442a-b69a-8ac17c027541', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:69:15', 'vm-uuid': 'ec0afde2-8d2b-451a-a226-be933e28ad6f'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:29 user nova-compute[72815]: INFO os_vif [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:69:15,bridge_name='br-int',has_traffic_filtering=True,id=5c1dfe2e-5dea-442a-b69a-8ac17c027541,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1dfe2e-5d')
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.network.neutron [None req-673e8349-a567-423d-a463-bc5bc03f173f tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updating instance_info_cache with network_info: [{"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No VIF found with MAC fa:16:3e:2f:69:15, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-673e8349-a567-423d-a463-bc5bc03f173f tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Releasing lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.objects.instance [None req-673e8349-a567-423d-a463-bc5bc03f173f tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'flavor' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No VIF found with MAC fa:16:3e:e8:55:36, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:59:30 user nova-compute[72815]: INFO nova.compute.claims [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Claim successful on node user
Aug 17 19:59:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d589dd57-e143-4823-a61e-7011b2bf2b7f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.204s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.network.neutron [req-28fc40e1-c559-4ffc-a564-709e43cb36cd req-f68587c9-75bf-4cc8-9567-df7d3c05cd26 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Updated VIF entry in instance network info cache for port 5c1dfe2e-5dea-442a-b69a-8ac17c027541. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.network.neutron [req-28fc40e1-c559-4ffc-a564-709e43cb36cd req-f68587c9-75bf-4cc8-9567-df7d3c05cd26 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Updating instance_info_cache with network_info: [{"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-28fc40e1-c559-4ffc-a564-709e43cb36cd req-f68587c9-75bf-4cc8-9567-df7d3c05cd26 service nova] Releasing lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Refreshing inventories for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Updating ProviderTree inventory for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Updating inventory in ProviderTree for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Refreshing aggregate associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, aggregates: None {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Refreshing trait associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-f4db9848-31e4-435a-b910-bc969d9a6715 req-bae5bd79-adf3-4b80-9b4c-3d7b95e9d96c service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-unplugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f4db9848-31e4-435a-b910-bc969d9a6715 req-bae5bd79-adf3-4b80-9b4c-3d7b95e9d96c service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f4db9848-31e4-435a-b910-bc969d9a6715 req-bae5bd79-adf3-4b80-9b4c-3d7b95e9d96c service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f4db9848-31e4-435a-b910-bc969d9a6715 req-bae5bd79-adf3-4b80-9b4c-3d7b95e9d96c service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-f4db9848-31e4-435a-b910-bc969d9a6715 req-bae5bd79-adf3-4b80-9b4c-3d7b95e9d96c service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-unplugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:31 user nova-compute[72815]: WARNING nova.compute.manager [req-f4db9848-31e4-435a-b910-bc969d9a6715 req-bae5bd79-adf3-4b80-9b4c-3d7b95e9d96c service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-unplugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state rescued and task_state unrescuing.
Aug 17 19:59:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.manager [req-77a6573e-a65e-4891-9ad4-e63cd3517aee req-5b1c7cea-2dc2-4c09-938b-fa25aef84f40 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-changed-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.manager [req-77a6573e-a65e-4891-9ad4-e63cd3517aee req-5b1c7cea-2dc2-4c09-938b-fa25aef84f40 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Refreshing instance network info cache due to event network-changed-991f5622-2c12-4ea1-950b-19b55e89c57c. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-77a6573e-a65e-4891-9ad4-e63cd3517aee req-5b1c7cea-2dc2-4c09-938b-fa25aef84f40 service nova] Acquiring lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-77a6573e-a65e-4891-9ad4-e63cd3517aee req-5b1c7cea-2dc2-4c09-938b-fa25aef84f40 service nova] Acquired lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.network.neutron [req-77a6573e-a65e-4891-9ad4-e63cd3517aee req-5b1c7cea-2dc2-4c09-938b-fa25aef84f40 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Refreshing network info cache for port 991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:32 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:59:32 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7144MB free_disk=25.427623748779297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:32 user nova-compute[72815]: INFO nova.compute.manager [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Rebuilding instance
Aug 17 19:59:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'trusted_certs' on Instance uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.141s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.189s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:32 user nova-compute[72815]: INFO nova.compute.manager [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Detaching volume 1c79b4ad-2ef9-42ee-8f37-aad0b223c4db
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:59:32 user nova-compute[72815]: INFO nova.virt.block_device [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Attempting to driver detach volume 1c79b4ad-2ef9-42ee-8f37-aad0b223c4db from mountpoint /dev/vdb
Aug 17 19:59:32 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'pci_requests' on Instance uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 07d46763-1b59-4cce-9e10-e94d0efea05d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 969a1301-2014-4b22-8074-a0ac35136249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 45b6365f-333f-45f1-b619-3453cbe75a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 3a4f27f3-4573-43b5-827a-bbdae4ebce10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ee4a8248-9abc-45b3-9bf6-349c4d11f189 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 03a874db-ce51-4502-839d-7cf9ff2f9259 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance a5f4e2b3-6d84-418d-9109-07a4362b4d7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'pci_devices' on Instance uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:32 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Instance destroyed successfully.
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'resources' on Instance uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Attempting to detach device vdb from instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:59:32 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:59:32 user nova-compute[72815]:   <source dev="/dev/sdb"/>
Aug 17 19:59:32 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:59:32 user nova-compute[72815]:   <serial>1c79b4ad-2ef9-42ee-8f37-aad0b223c4db</serial>
Aug 17 19:59:32 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 19:59:32 user nova-compute[72815]: </disk>
Aug 17 19:59:32 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'migration_context' on Instance uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:32 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully detached device vdb from instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 from the persistent domain config.
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:59:32 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:59:32 user nova-compute[72815]:   <source dev="/dev/sdb"/>
Aug 17 19:59:32 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:59:32 user nova-compute[72815]:   <serial>1c79b4ad-2ef9-42ee-8f37-aad0b223c4db</serial>
Aug 17 19:59:32 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 19:59:32 user nova-compute[72815]: </disk>
Aug 17 19:59:32 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72815) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.policy [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '190c2e4fdf3e49c3a760e332ab09baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddf9ff8534e4c1c8afc48c9d02fefcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:59:32 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Creating image(s)
Aug 17 19:59:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "/opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "/opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "c81b47fb2bb00d6cf80426b18fbba864bc0ee267" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "c81b47fb2bb00d6cf80426b18fbba864bc0ee267" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267.part --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302373.6396418, 1800ab7b-dd88-45fb-9370-1b77b8cbf893 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:34 user nova-compute[72815]: WARNING nova.compute.manager [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state rescued and task_state unrescuing.
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] No waiting events found dispatching network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:34 user nova-compute[72815]: WARNING nova.compute.manager [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received unexpected event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe for instance with vm_state building and task_state spawning.
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] No waiting events found dispatching network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:34 user nova-compute[72815]: WARNING nova.compute.manager [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received unexpected event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe for instance with vm_state building and task_state spawning.
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:34 user nova-compute[72815]: WARNING nova.compute.manager [req-d25419e2-80b5-40e6-8878-2c85852a52f0 req-9907ab22-56b9-40ed-8a37-194acb9bb7e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state rescued and task_state unrescuing.
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-5746df09-e84b-4877-8be9-0efe0a9728a7 req-94e0d6e4-0057-4eab-843c-91d0d8baddf4 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received event network-vif-unplugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5746df09-e84b-4877-8be9-0efe0a9728a7 req-94e0d6e4-0057-4eab-843c-91d0d8baddf4 service nova] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5746df09-e84b-4877-8be9-0efe0a9728a7 req-94e0d6e4-0057-4eab-843c-91d0d8baddf4 service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5746df09-e84b-4877-8be9-0efe0a9728a7 req-94e0d6e4-0057-4eab-843c-91d0d8baddf4 service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-5746df09-e84b-4877-8be9-0efe0a9728a7 req-94e0d6e4-0057-4eab-843c-91d0d8baddf4 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] No waiting events found dispatching network-vif-unplugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:34 user nova-compute[72815]: WARNING nova.compute.manager [req-5746df09-e84b-4877-8be9-0efe0a9728a7 req-94e0d6e4-0057-4eab-843c-91d0d8baddf4 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received unexpected event network-vif-unplugged-8efa8696-1a0f-42c7-a009-0700e77b8923 for instance with vm_state active and task_state rebuilding.
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-changed-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Refreshing instance network info cache due to event network-changed-991f5622-2c12-4ea1-950b-19b55e89c57c. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] Acquiring lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 19:59:34 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully detached device vdb from instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 from the live domain config.
Aug 17 19:59:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMXxRwDl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:34 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267.part --force-share --output=json" returned: 0 in 0.212s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.virt.images [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] 3f8293f6-06fa-4f58-a508-fa1c7a2ee0d1 was qcow2, converting to raw {{(pid=72815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267.part /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267.converted {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc26d8ed-8b08-4d56-9fec-c6d073666ce8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35b726a-d0d6-431a-9dc3-37e909ddc229]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:34 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:34 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:59:34 user nova-compute[72815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 19:59:34 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:34 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:34 user nova-compute[72815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db (non-flash)
Aug 17 19:59:34 user nova-compute[72815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 19:59:34 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944a6830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db'): ({'sdb'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Removing single pathed devices sdb {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.086s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[32915029-f525-472e-9a87-ee3e4666992b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dac198-fea4-4064-8908-5f033727913a]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Flushing IO for device /dev/sdb {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eb9e41-7f7f-41c1-8ed5-9f41da9c3da8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3f48fc-0ca3-45ac-a4f7-ab5112a5cf27]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Successfully created port: 419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267.part /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267.converted" returned: 0 in 0.332s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267.converted --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d9108c-1d75-4979-a20f-4dffb6dac3ef]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.network.neutron [req-77a6573e-a65e-4891-9ad4-e63cd3517aee req-5b1c7cea-2dc2-4c09-938b-fa25aef84f40 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updated VIF entry in instance network info cache for port 991f5622-2c12-4ea1-950b-19b55e89c57c. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.network.neutron [req-77a6573e-a65e-4891-9ad4-e63cd3517aee req-5b1c7cea-2dc2-4c09-938b-fa25aef84f40 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updating instance_info_cache with network_info: [{"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-77a6573e-a65e-4891-9ad4-e63cd3517aee req-5b1c7cea-2dc2-4c09-938b-fa25aef84f40 service nova] Releasing lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] Acquired lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.network.neutron [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Refreshing network info cache for port 991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8722a9b-aa87-4f24-898d-7e5f1d5cc740]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260]
Aug 17 19:59:34 user nova-compute[72815]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db, portal: 172.16.0.220,3260] successful.
Aug 17 19:59:34 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.451s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] There are 0 instances to clean {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c79b4ad-2ef9-42ee-8f37-aad0b223c4db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c3b8f9-7d45-44c1-83ae-cf1c2238d3b6]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.571s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] <== disconnect_volume: return (572ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:59:35 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Instance destroyed successfully.
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "c81b47fb2bb00d6cf80426b18fbba864bc0ee267" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.061s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: INFO nova.compute.manager [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Detaching volume c500c537-a5a5-45c9-9d49-de565adcbbf0
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267 --force-share --output=json" returned: 0 in 0.202s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "c81b47fb2bb00d6cf80426b18fbba864bc0ee267" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "c81b47fb2bb00d6cf80426b18fbba864bc0ee267" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: INFO nova.virt.block_device [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Attempting to driver detach volume c500c537-a5a5-45c9-9d49-de565adcbbf0 from mountpoint /dev/vdb
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267 --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267,backing_fmt=raw /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:35 user nova-compute[72815]: WARNING nova.compute.manager [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state rescued and task_state unrescuing.
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-unplugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-unplugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:35 user nova-compute[72815]: WARNING nova.compute.manager [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-unplugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state rescued and task_state unrescuing.
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:35 user nova-compute[72815]: WARNING nova.compute.manager [req-3492f86f-c6ef-4ebe-a9b3-277acb8632bc req-7cdaccab-2791-4e2e-9188-728b9f1197ca service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state rescued and task_state unrescuing.
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267,backing_fmt=raw /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk 1073741824" returned: 0 in 0.062s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "c81b47fb2bb00d6cf80426b18fbba864bc0ee267" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Attempting to detach device vdb from instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:59:35 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:59:35 user nova-compute[72815]:   <source dev="/dev/sde"/>
Aug 17 19:59:35 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:59:35 user nova-compute[72815]:   <serial>c500c537-a5a5-45c9-9d49-de565adcbbf0</serial>
Aug 17 19:59:35 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:59:35 user nova-compute[72815]: </disk>
Aug 17 19:59:35 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:59:35 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully detached device vdb from instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 from the persistent domain config.
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRdiENpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:35 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-4af7a7d1-62ea-49e7-99f6-5274e62fcecb req-493e9423-58b2-4859-a375-7ae48742ddce service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received event network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4af7a7d1-62ea-49e7-99f6-5274e62fcecb req-493e9423-58b2-4859-a375-7ae48742ddce service nova] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4af7a7d1-62ea-49e7-99f6-5274e62fcecb req-493e9423-58b2-4859-a375-7ae48742ddce service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4af7a7d1-62ea-49e7-99f6-5274e62fcecb req-493e9423-58b2-4859-a375-7ae48742ddce service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-4af7a7d1-62ea-49e7-99f6-5274e62fcecb req-493e9423-58b2-4859-a375-7ae48742ddce service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] No waiting events found dispatching network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:35 user nova-compute[72815]: WARNING nova.compute.manager [req-4af7a7d1-62ea-49e7-99f6-5274e62fcecb req-493e9423-58b2-4859-a375-7ae48742ddce service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received unexpected event network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 for instance with vm_state active and task_state rebuilding.
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2cfcf7-236e-465e-b52b-037c62dc7f96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.network.neutron [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updated VIF entry in instance network info cache for port 991f5622-2c12-4ea1-950b-19b55e89c57c. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.network.neutron [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updating instance_info_cache with network_info: [{"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[99141ca7-f1ca-456a-a469-079e75c84d65]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:35 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:35 user nova-compute[72815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 19:59:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:35 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:35 user nova-compute[72815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 19:59:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994455b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0'): ({'sde'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Removing single pathed devices sde {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] Releasing lock "refresh_cache-07d46763-1b59-4cce-9e10-e94d0efea05d" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received event network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] No waiting events found dispatching network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:35 user nova-compute[72815]: WARNING nova.compute.manager [req-2405017b-2f4b-4fb1-a71c-c6e6299ffe20 req-f3a4a1c8-00f3-4af0-9985-efb3662c0b8b service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received unexpected event network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 for instance with vm_state building and task_state spawning.
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267 --force-share --output=json" returned: 0 in 0.198s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.objects.instance [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lazy-loading 'migration_context' on Instance uuid a5f4e2b3-6d84-418d-9109-07a4362b4d7b {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Successfully updated port: 419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f1fabb-d4ef-41a1-a904-6473f3c576d3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Ensure instance console log exists: /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "refresh_cache-a5f4e2b3-6d84-418d-9109-07a4362b4d7b" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquired lock "refresh_cache-a5f4e2b3-6d84-418d-9109-07a4362b4d7b" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68374e3-579f-4228-8557-1183a0f954ab]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flushing IO for device /dev/sde {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7ae35a-f472-4741-85c0-fe841ea929a9]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b384c876-6d88-49ff-ad3c-2e6d7950422b]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[272520b5-0607-4084-8b5d-4cc6d1c2e452]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-aee3ce1b-18b8-4ba1-8970-7d610ece04b7 req-b14bbc6d-494f-40c0-a492-393023424b29 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received event network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-aee3ce1b-18b8-4ba1-8970-7d610ece04b7 req-b14bbc6d-494f-40c0-a492-393023424b29 service nova] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-aee3ce1b-18b8-4ba1-8970-7d610ece04b7 req-b14bbc6d-494f-40c0-a492-393023424b29 service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-aee3ce1b-18b8-4ba1-8970-7d610ece04b7 req-b14bbc6d-494f-40c0-a492-393023424b29 service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-aee3ce1b-18b8-4ba1-8970-7d610ece04b7 req-b14bbc6d-494f-40c0-a492-393023424b29 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] No waiting events found dispatching network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:35 user nova-compute[72815]: WARNING nova.compute.manager [req-aee3ce1b-18b8-4ba1-8970-7d610ece04b7 req-b14bbc6d-494f-40c0-a492-393023424b29 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received unexpected event network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 for instance with vm_state building and task_state spawning.
Aug 17 19:59:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[de973b99-f0d2-4234-bda5-9ccd7ce72dfc]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260]
Aug 17 19:59:35 user nova-compute[72815]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260] successful.
Aug 17 19:59:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbfccf2-8fda-4895-a9d5-d49a32c77b9a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== disconnect_volume: return (362ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Updating instance_info_cache with network_info: [{"id": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "address": "fa:16:3e:ed:51:37", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419cc7ce-bd", "ovs_interfaceid": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Releasing lock "refresh_cache-a5f4e2b3-6d84-418d-9109-07a4362b4d7b" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Instance network_info: |[{"id": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "address": "fa:16:3e:ed:51:37", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419cc7ce-bd", "ovs_interfaceid": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Start _get_guest_xml network_info=[{"id": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "address": "fa:16:3e:ed:51:37", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419cc7ce-bd", "ovs_interfaceid": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b59d0bc8fb7dfbe4c332842fc41881d5',container_format='bare',created_at=2023-08-17T19:59:20Z,direct_url=<?>,disk_format='qcow2',id=3f8293f6-06fa-4f58-a508-fa1c7a2ee0d1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-35029541',owner='dddf9ff8534e4c1c8afc48c9d02fefcb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T19:59:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '3f8293f6-06fa-4f58-a508-fa1c7a2ee0d1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:59:36 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:59:36 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b59d0bc8fb7dfbe4c332842fc41881d5',container_format='bare',created_at=2023-08-17T19:59:20Z,direct_url=<?>,disk_format='qcow2',id=3f8293f6-06fa-4f58-a508-fa1c7a2ee0d1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-35029541',owner='dddf9ff8534e4c1c8afc48c9d02fefcb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T19:59:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-286806879',display_name='tempest-TestStampPattern-server-286806879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-286806879',id=21,image_ref='3f8293f6-06fa-4f58-a508-fa1c7a2ee0d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqC6RUkKN1taHh2Rn8c1allkbJ0/yuwdo3QXAdudNtPlH8PHi5tBUQIsWAsylFF7ZKs0Ps3Kru7ooqRhdzKKP021tMxib7YsWN4dc0onmkUhJNvpAEEo06cjY/saqY+9Q==',key_name='tempest-TestStampPattern-190535839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dddf9ff8534e4c1c8afc48c9d02fefcb',ramdisk_id='',reservation_id='r-2lszp9xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='45b6365f-333f-45f1-b619-3453cbe75a88',image_min_disk='1',image_min_ram='0',image_owner_id='dddf9ff8534e4c1c8afc48c9d02fefcb',image_owner_project_name='tempest-TestStampPattern-1204244634',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1204244634-project-member',image_user_id='190c2e4fdf3e49c3a760e332ab09baf3',network_allocated='True',owner_project_name='tempest-TestStampPattern-1204244634',owner_user_name='tempest-TestStampPattern-1204244634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:33Z,user_data=None,user_id='190c2e4fdf3e49c3a760e332ab09baf3',uuid=a5f4e2b3-6d84-418d-9109-07a4362b4d7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "address": "fa:16:3e:ed:51:37", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419cc7ce-bd", "ovs_interfaceid": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Converting VIF {"id": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "address": "fa:16:3e:ed:51:37", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419cc7ce-bd", "ovs_interfaceid": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:51:37,bridge_name='br-int',has_traffic_filtering=True,id=419cc7ce-bdbb-4add-81ff-e40402e5997d,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419cc7ce-bd') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.objects.instance [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lazy-loading 'pci_devices' on Instance uuid a5f4e2b3-6d84-418d-9109-07a4362b4d7b {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:59:36 user nova-compute[72815]:   <uuid>a5f4e2b3-6d84-418d-9109-07a4362b4d7b</uuid>
Aug 17 19:59:36 user nova-compute[72815]:   <name>instance-00000015</name>
Aug 17 19:59:36 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:59:36 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:59:36 user nova-compute[72815]:   <metadata>
Aug 17 19:59:36 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:59:36 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:59:36 user nova-compute[72815]:       <nova:name>tempest-TestStampPattern-server-286806879</nova:name>
Aug 17 19:59:36 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:59:36</nova:creationTime>
Aug 17 19:59:36 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:59:36 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:59:36 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:59:36 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:59:36 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:59:36 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:59:36 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:59:36 user nova-compute[72815]:       <nova:owner>
Aug 17 19:59:36 user nova-compute[72815]:         <nova:user uuid="190c2e4fdf3e49c3a760e332ab09baf3">tempest-TestStampPattern-1204244634-project-member</nova:user>
Aug 17 19:59:36 user nova-compute[72815]:         <nova:project uuid="dddf9ff8534e4c1c8afc48c9d02fefcb">tempest-TestStampPattern-1204244634</nova:project>
Aug 17 19:59:36 user nova-compute[72815]:       </nova:owner>
Aug 17 19:59:36 user nova-compute[72815]:       <nova:root type="image" uuid="3f8293f6-06fa-4f58-a508-fa1c7a2ee0d1"/>
Aug 17 19:59:36 user nova-compute[72815]:       <nova:ports>
Aug 17 19:59:36 user nova-compute[72815]:         <nova:port uuid="419cc7ce-bdbb-4add-81ff-e40402e5997d">
Aug 17 19:59:36 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 19:59:36 user nova-compute[72815]:         </nova:port>
Aug 17 19:59:36 user nova-compute[72815]:       </nova:ports>
Aug 17 19:59:36 user nova-compute[72815]:     </nova:instance>
Aug 17 19:59:36 user nova-compute[72815]:   </metadata>
Aug 17 19:59:36 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:59:36 user nova-compute[72815]:     <system>
Aug 17 19:59:36 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:59:36 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:59:36 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:59:36 user nova-compute[72815]:       <entry name="serial">a5f4e2b3-6d84-418d-9109-07a4362b4d7b</entry>
Aug 17 19:59:36 user nova-compute[72815]:       <entry name="uuid">a5f4e2b3-6d84-418d-9109-07a4362b4d7b</entry>
Aug 17 19:59:36 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:59:36 user nova-compute[72815]:     </system>
Aug 17 19:59:36 user nova-compute[72815]:   </sysinfo>
Aug 17 19:59:36 user nova-compute[72815]:   <os>
Aug 17 19:59:36 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:59:36 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:59:36 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:59:36 user nova-compute[72815]:   </os>
Aug 17 19:59:36 user nova-compute[72815]:   <features>
Aug 17 19:59:36 user nova-compute[72815]:     <acpi/>
Aug 17 19:59:36 user nova-compute[72815]:     <apic/>
Aug 17 19:59:36 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:59:36 user nova-compute[72815]:   </features>
Aug 17 19:59:36 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:59:36 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:59:36 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:59:36 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:59:36 user nova-compute[72815]:   </clock>
Aug 17 19:59:36 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:59:36 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:59:36 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:59:36 user nova-compute[72815]:   </cpu>
Aug 17 19:59:36 user nova-compute[72815]:   <devices>
Aug 17 19:59:36 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:59:36 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:59:36 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk"/>
Aug 17 19:59:36 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:59:36 user nova-compute[72815]:     </disk>
Aug 17 19:59:36 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:59:36 user nova-compute[72815]:       <mac address="fa:16:3e:ed:51:37"/>
Aug 17 19:59:36 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:36 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:59:36 user nova-compute[72815]:       <target dev="tap419cc7ce-bd"/>
Aug 17 19:59:36 user nova-compute[72815]:     </interface>
Aug 17 19:59:36 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:59:36 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/console.log" append="off"/>
Aug 17 19:59:36 user nova-compute[72815]:     </serial>
Aug 17 19:59:36 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:59:36 user nova-compute[72815]:     <video>
Aug 17 19:59:36 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:36 user nova-compute[72815]:     </video>
Aug 17 19:59:36 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:59:36 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:59:36 user nova-compute[72815]:     </rng>
Aug 17 19:59:36 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:59:36 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:59:36 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:59:36 user nova-compute[72815]:     </memballoon>
Aug 17 19:59:36 user nova-compute[72815]:   </devices>
Aug 17 19:59:36 user nova-compute[72815]: </domain>
Aug 17 19:59:36 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-286806879',display_name='tempest-TestStampPattern-server-286806879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-286806879',id=21,image_ref='3f8293f6-06fa-4f58-a508-fa1c7a2ee0d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqC6RUkKN1taHh2Rn8c1allkbJ0/yuwdo3QXAdudNtPlH8PHi5tBUQIsWAsylFF7ZKs0Ps3Kru7ooqRhdzKKP021tMxib7YsWN4dc0onmkUhJNvpAEEo06cjY/saqY+9Q==',key_name='tempest-TestStampPattern-190535839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dddf9ff8534e4c1c8afc48c9d02fefcb',ramdisk_id='',reservation_id='r-2lszp9xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='45b6365f-333f-45f1-b619-3453cbe75a88',image_min_disk='1',image_min_ram='0',image_owner_id='dddf9ff8534e4c1c8afc48c9d02fefcb',image_owner_project_name='tempest-TestStampPattern-1204244634',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1204244634-project-member',image_user_id='190c2e4fdf3e49c3a760e332ab09baf3',network_allocated='True',owner_project_name='tempest-TestStampPattern-1204244634',owner_user_name='tempest-TestStampPattern-1204244634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:33Z,user_data=None,user_id='190c2e4fdf3e49c3a760e332ab09baf3',uuid=a5f4e2b3-6d84-418d-9109-07a4362b4d7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "address": "fa:16:3e:ed:51:37", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419cc7ce-bd", "ovs_interfaceid": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Converting VIF {"id": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "address": "fa:16:3e:ed:51:37", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419cc7ce-bd", "ovs_interfaceid": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:51:37,bridge_name='br-int',has_traffic_filtering=True,id=419cc7ce-bdbb-4add-81ff-e40402e5997d,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419cc7ce-bd') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG os_vif [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:51:37,bridge_name='br-int',has_traffic_filtering=True,id=419cc7ce-bdbb-4add-81ff-e40402e5997d,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419cc7ce-bd') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap419cc7ce-bd, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap419cc7ce-bd, col_values=(('external_ids', {'iface-id': '419cc7ce-bdbb-4add-81ff-e40402e5997d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:51:37', 'vm-uuid': 'a5f4e2b3-6d84-418d-9109-07a4362b4d7b'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:36 user nova-compute[72815]: INFO os_vif [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:51:37,bridge_name='br-int',has_traffic_filtering=True,id=419cc7ce-bdbb-4add-81ff-e40402e5997d,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419cc7ce-bd')
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] No VIF found with MAC fa:16:3e:ed:51:37, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302376.689561, dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:36 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] VM Resumed (Lifecycle Event)
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:59:36 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Instance spawned successfully.
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:59:36 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302376.6937354, dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:36 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] VM Started (Lifecycle Event)
Aug 17 19:59:36 user nova-compute[72815]: INFO nova.compute.manager [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Took 11.43 seconds to spawn the instance on the hypervisor.
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:59:36 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:59:36 user nova-compute[72815]: INFO nova.compute.manager [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Took 12.38 seconds to build instance.
Aug 17 19:59:36 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Instance destroyed successfully.
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1853215392',display_name='tempest-ServerActionsTestOtherA-server-1223347787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1853215392',id=16,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDN+itvlDzHBO+C0L5CdVVjN9zLYJQZyVMxIHI48MdeloXzEtFXvxcRexB54et5sFgI02m27W5UFXQX0FgRie2BIaKjkATT3pAVtNYbH9Q9MC8QkDr8EAwxg7wvp+8x62Q==',key_name='tempest-keypair-1413124709',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:57:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-06lrf0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG os_vif [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8efa8696-1a, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a07d0f49-ef13-4251-a359-faee6205b09c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.499s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:36 user nova-compute[72815]: INFO os_vif [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a')
Aug 17 19:59:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRdiENpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:36 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 19:59:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:59:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ccf9ef-3248-460c-b791-2748861c763a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b3bbb7-028f-4aae-a4d5-457230e577db]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:37 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:37 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399434af80>, {}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Disconnecting from: [] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== disconnect_volume: return (70ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:59:37 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Deleting instance files /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0_del
Aug 17 19:59:37 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Deletion of /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0_del complete
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-969a1301-2014-4b22-8074-a0ac35136249" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-969a1301-2014-4b22-8074-a0ac35136249" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:59:37 user nova-compute[72815]: INFO nova.virt.block_device [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Booting with volume c500c537-a5a5-45c9-9d49-de565adcbbf0 at /dev/vdb
Aug 17 19:59:37 user nova-compute[72815]: DEBUG os_brick.utils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79f4824-fd28-49ce-afc2-c25c47dc555c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc6a432-bb71-4b60-8837-9076016c5024]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[04519728-6593-4c2a-9d9c-8f13cc5169a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb25179-547b-433f-8222-8addb75218c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.compute.manager [req-7a1009b6-c8fd-4412-a49b-99f8b5d118f7 req-c39e5ce8-bdda-4923-8af2-d7a0f8d9f610 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7a1009b6-c8fd-4412-a49b-99f8b5d118f7 req-c39e5ce8-bdda-4923-8af2-d7a0f8d9f610 service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7a1009b6-c8fd-4412-a49b-99f8b5d118f7 req-c39e5ce8-bdda-4923-8af2-d7a0f8d9f610 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7a1009b6-c8fd-4412-a49b-99f8b5d118f7 req-c39e5ce8-bdda-4923-8af2-d7a0f8d9f610 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.compute.manager [req-7a1009b6-c8fd-4412-a49b-99f8b5d118f7 req-c39e5ce8-bdda-4923-8af2-d7a0f8d9f610 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:37 user nova-compute[72815]: WARNING nova.compute.manager [req-7a1009b6-c8fd-4412-a49b-99f8b5d118f7 req-c39e5ce8-bdda-4923-8af2-d7a0f8d9f610 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state rescued and task_state unrescuing.
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.compute.manager [req-7a1009b6-c8fd-4412-a49b-99f8b5d118f7 req-c39e5ce8-bdda-4923-8af2-d7a0f8d9f610 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7a1009b6-c8fd-4412-a49b-99f8b5d118f7 req-c39e5ce8-bdda-4923-8af2-d7a0f8d9f610 service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7a1009b6-c8fd-4412-a49b-99f8b5d118f7 req-c39e5ce8-bdda-4923-8af2-d7a0f8d9f610 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7a1009b6-c8fd-4412-a49b-99f8b5d118f7 req-c39e5ce8-bdda-4923-8af2-d7a0f8d9f610 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.compute.manager [req-7a1009b6-c8fd-4412-a49b-99f8b5d118f7 req-c39e5ce8-bdda-4923-8af2-d7a0f8d9f610 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:37 user nova-compute[72815]: WARNING nova.compute.manager [req-7a1009b6-c8fd-4412-a49b-99f8b5d118f7 req-c39e5ce8-bdda-4923-8af2-d7a0f8d9f610 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state rescued and task_state unrescuing.
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:59:37 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf93262-a9d4-4177-8f7f-9edc532b61b3]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG os_brick.utils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Updating existing volume attachment record: 373180fe-add0-4fac-9169-97a184e64398 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.compute.manager [req-8c80c141-fdef-4dd6-9abc-b41f71241d94 req-eab0a3b9-8949-4536-a4a4-7c1dc8ea1485 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Received event network-changed-419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.compute.manager [req-8c80c141-fdef-4dd6-9abc-b41f71241d94 req-eab0a3b9-8949-4536-a4a4-7c1dc8ea1485 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Refreshing instance network info cache due to event network-changed-419cc7ce-bdbb-4add-81ff-e40402e5997d. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8c80c141-fdef-4dd6-9abc-b41f71241d94 req-eab0a3b9-8949-4536-a4a4-7c1dc8ea1485 service nova] Acquiring lock "refresh_cache-a5f4e2b3-6d84-418d-9109-07a4362b4d7b" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8c80c141-fdef-4dd6-9abc-b41f71241d94 req-eab0a3b9-8949-4536-a4a4-7c1dc8ea1485 service nova] Acquired lock "refresh_cache-a5f4e2b3-6d84-418d-9109-07a4362b4d7b" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.network.neutron [req-8c80c141-fdef-4dd6-9abc-b41f71241d94 req-eab0a3b9-8949-4536-a4a4-7c1dc8ea1485 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Refreshing network info cache for port 419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Updating instance_info_cache with network_info: [{"id": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "address": "fa:16:3e:e1:b7:04", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71991ae2-16", "ovs_interfaceid": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-969a1301-2014-4b22-8074-a0ac35136249" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302377.909635, ec0afde2-8d2b-451a-a226-be933e28ad6f => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:37 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] VM Resumed (Lifecycle Event)
Aug 17 19:59:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:37 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Instance spawned successfully.
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:38 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302377.9115534, ec0afde2-8d2b-451a-a226-be933e28ad6f => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:38 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] VM Started (Lifecycle Event)
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:59:38 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:59:38 user nova-compute[72815]: INFO nova.compute.manager [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Took 11.40 seconds to spawn the instance on the hypervisor.
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.network.neutron [req-8c80c141-fdef-4dd6-9abc-b41f71241d94 req-eab0a3b9-8949-4536-a4a4-7c1dc8ea1485 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Updated VIF entry in instance network info cache for port 419cc7ce-bdbb-4add-81ff-e40402e5997d. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.network.neutron [req-8c80c141-fdef-4dd6-9abc-b41f71241d94 req-eab0a3b9-8949-4536-a4a4-7c1dc8ea1485 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Updating instance_info_cache with network_info: [{"id": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "address": "fa:16:3e:ed:51:37", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419cc7ce-bd", "ovs_interfaceid": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8c80c141-fdef-4dd6-9abc-b41f71241d94 req-eab0a3b9-8949-4536-a4a4-7c1dc8ea1485 service nova] Releasing lock "refresh_cache-a5f4e2b3-6d84-418d-9109-07a4362b4d7b" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:59:38 user nova-compute[72815]: INFO nova.compute.manager [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Took 12.94 seconds to build instance.
Aug 17 19:59:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4488ca5-31d6-4a85-9121-e391d22cd4a0 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.093s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-673e8349-a567-423d-a463-bc5bc03f173f tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for 07d46763-1b59-4cce-9e10-e94d0efea05d due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302378.60475, 07d46763-1b59-4cce-9e10-e94d0efea05d => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:38 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] VM Resumed (Lifecycle Event)
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:59:38 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302378.6134994, 07d46763-1b59-4cce-9e10-e94d0efea05d => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:38 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] VM Started (Lifecycle Event)
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:59:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-ebd287e1-a3b9-48b9-8ab9-3eb4dadf464b req-da9436e0-0142-4c0f-8ea7-7023425bcaad service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Received event network-vif-plugged-419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ebd287e1-a3b9-48b9-8ab9-3eb4dadf464b req-da9436e0-0142-4c0f-8ea7-7023425bcaad service nova] Acquiring lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ebd287e1-a3b9-48b9-8ab9-3eb4dadf464b req-da9436e0-0142-4c0f-8ea7-7023425bcaad service nova] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ebd287e1-a3b9-48b9-8ab9-3eb4dadf464b req-da9436e0-0142-4c0f-8ea7-7023425bcaad service nova] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-ebd287e1-a3b9-48b9-8ab9-3eb4dadf464b req-da9436e0-0142-4c0f-8ea7-7023425bcaad service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] No waiting events found dispatching network-vif-plugged-419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:39 user nova-compute[72815]: WARNING nova.compute.manager [req-ebd287e1-a3b9-48b9-8ab9-3eb4dadf464b req-da9436e0-0142-4c0f-8ea7-7023425bcaad service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Received unexpected event network-vif-plugged-419cc7ce-bdbb-4add-81ff-e40402e5997d for instance with vm_state building and task_state spawning.
Aug 17 19:59:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-ebd287e1-a3b9-48b9-8ab9-3eb4dadf464b req-da9436e0-0142-4c0f-8ea7-7023425bcaad service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Received event network-vif-plugged-419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ebd287e1-a3b9-48b9-8ab9-3eb4dadf464b req-da9436e0-0142-4c0f-8ea7-7023425bcaad service nova] Acquiring lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ebd287e1-a3b9-48b9-8ab9-3eb4dadf464b req-da9436e0-0142-4c0f-8ea7-7023425bcaad service nova] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ebd287e1-a3b9-48b9-8ab9-3eb4dadf464b req-da9436e0-0142-4c0f-8ea7-7023425bcaad service nova] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-ebd287e1-a3b9-48b9-8ab9-3eb4dadf464b req-da9436e0-0142-4c0f-8ea7-7023425bcaad service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] No waiting events found dispatching network-vif-plugged-419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:39 user nova-compute[72815]: WARNING nova.compute.manager [req-ebd287e1-a3b9-48b9-8ab9-3eb4dadf464b req-da9436e0-0142-4c0f-8ea7-7023425bcaad service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Received unexpected event network-vif-plugged-419cc7ce-bdbb-4add-81ff-e40402e5997d for instance with vm_state building and task_state spawning.
Aug 17 19:59:40 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302380.7180195, a5f4e2b3-6d84-418d-9109-07a4362b4d7b => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:40 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] VM Resumed (Lifecycle Event)
Aug 17 19:59:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:59:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:59:40 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Instance spawned successfully.
Aug 17 19:59:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:59:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:59:40 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:59:40 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302380.7235765, a5f4e2b3-6d84-418d-9109-07a4362b4d7b => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:40 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] VM Started (Lifecycle Event)
Aug 17 19:59:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:59:40 user nova-compute[72815]: INFO nova.compute.manager [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Took 7.94 seconds to spawn the instance on the hypervisor.
Aug 17 19:59:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:40 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:59:40 user nova-compute[72815]: INFO nova.compute.manager [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Took 11.01 seconds to build instance.
Aug 17 19:59:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ef84bd2c-51bd-4ba8-ba81-04e010d4a96c tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.199s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:59:43 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Creating image(s)
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Ensure instance console log exists: /opt/stack/data/nova/instances/03a874db-ce51-4502-839d-7cf9ff2f9259/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Start _get_guest_xml network_info=[{"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "address": "fa:16:3e:26:ef:49", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22dad22-87", "ovs_interfaceid": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1ace327-2298-4cd7-b9ae-40656e87871b", "address": "fa:16:3e:d7:d5:73", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace327-22", "ovs_interfaceid": "c1ace327-2298-4cd7-b9ae-40656e87871b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '669fc3c3-6b95-43f2-8dd7-8f16407eff62', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emdriUtY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03a874db-ce51-4502-839d-7cf9ff2f9259', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa3094f0-c65a-4888-8928-93bd3dcc63fe', 'serial': 'fa3094f0-c65a-4888-8928-93bd3dcc63fe'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'attachment_id': '93ecf03a-1925-4b6f-9a28-17c672e4a310', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvzANDBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03a874db-ce51-4502-839d-7cf9ff2f9259', 'attached_at': '', 'detached_at': '', 'volume_id': '7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae', 'serial': '7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'attachment_id': 'a92f4e18-4296-474b-81b4-f2569159cc7d', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIJEpKiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03a874db-ce51-4502-839d-7cf9ff2f9259', 'attached_at': '', 'detached_at': '', 'volume_id': '443cbc27-a597-4636-8ae6-31f8cc49009d', 'serial': '443cbc27-a597-4636-8ae6-31f8cc49009d'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:43 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:59:43 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emdriUtY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:43 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:43 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:43 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2ee0d75b-b184-42e9-907e-2f4f6c1abb74 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.962s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[10acdf23-3fbc-464c-b8c4-4c38fc9292f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:59:43 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83fad3d-8e7e-4103-ba20-c0b8dbe2d473]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe] added
Aug 17 19:59:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d069dc6-376c-4941-86eb-d9716cde34ef]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b0878f-8b91-4191-a02c-6313f7ad37e3]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v emdriUtY {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v emdriUtY" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14eea0c-64bb-476b-a61b-6d9d045614d5]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'emdriUtY'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[59382c02-71f8-4ccc-82b9-e7254b611a33]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e3bfbe-0729-4e3b-8334-5e13dc5ee8fa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:43 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:43 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b675a884-e45e-440b-8188-e4c0c684d878]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe, portal: 172.16.0.220,3260]
Aug 17 19:59:43 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe, portal: 172.16.0.220,3260] successful.
Aug 17 19:59:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17bea97-cec4-499d-b22a-8157ece6b679]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ece7490-c9f2-4a3e-aef4-8234161d0e50]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:43 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:43 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:43 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:43 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae079dd0-ce7c-4ef4-8377-d909a4446c00]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:59:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emdriUtY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7a334619-aabd-43a5-b6bd-6c115df49f08 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7a334619-aabd-43a5-b6bd-6c115df49f08 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7a334619-aabd-43a5-b6bd-6c115df49f08 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7a334619-aabd-43a5-b6bd-6c115df49f08 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72815) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7a334619-aabd-43a5-b6bd-6c115df49f08 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-65b8ff93-4b38-458a-9897-54934b4b83d1 req-6038e4d4-f551-457a-bc0b-3adc430908dd service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-unplugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-65b8ff93-4b38-458a-9897-54934b4b83d1 req-6038e4d4-f551-457a-bc0b-3adc430908dd service nova] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-65b8ff93-4b38-458a-9897-54934b4b83d1 req-6038e4d4-f551-457a-bc0b-3adc430908dd service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-65b8ff93-4b38-458a-9897-54934b4b83d1 req-6038e4d4-f551-457a-bc0b-3adc430908dd service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-65b8ff93-4b38-458a-9897-54934b4b83d1 req-6038e4d4-f551-457a-bc0b-3adc430908dd service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] No waiting events found dispatching network-vif-unplugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:44 user nova-compute[72815]: WARNING nova.compute.manager [req-65b8ff93-4b38-458a-9897-54934b4b83d1 req-6038e4d4-f551-457a-bc0b-3adc430908dd service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received unexpected event network-vif-unplugged-7d010d95-173c-44df-be70-170e3ca59b0e for instance with vm_state active and task_state powering-off.
Aug 17 19:59:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23663303161633466', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663303161633466', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvzANDBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:44 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:59:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:44 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:59:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:44 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:59:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f2c9a7-fe88-4a07-b148-0332db05af32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:59:44 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d90b603-0fae-4b74-acfc-329672d78a0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae] added
Aug 17 19:59:44 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd66c8f-bf63-4a0c-9b0c-086684ae41cb]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cff1a3-a5a7-4d4a-a896-dcf45a1b396c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvzANDBX {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvzANDBX" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d63e48-0206-4a21-b840-dcf08364673c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvzANDBX'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3d1a65-4b6f-47e5-861b-d25523b496ea]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57aa028-5f49-4cf4-89c2-b7ca39d785e3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:45 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:45 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:45 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:45 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76b8c85-9019-4dc9-9b82-1f054b6d16eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae, portal: 172.16.0.220,3260]
Aug 17 19:59:45 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae, portal: 172.16.0.220,3260] successful.
Aug 17 19:59:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c23db2f-74d5-4e2e-af38-f31366c43185]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14d65b0-862c-4752-aa62-12be62e2f4a6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:45 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:45 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:45 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 19:59:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:45 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:45 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:45 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 19:59:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.051s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fb4e85-ea56-4b26-9f6d-61cf7cf626bd]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvzANDBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:59:45 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance destroyed successfully.
Aug 17 19:59:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7a334619-aabd-43a5-b6bd-6c115df49f08 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7a334619-aabd-43a5-b6bd-6c115df49f08 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.152s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '23235343066376234', 'path': '/dev/sde'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235343066376234', 'path': '/dev/sde'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIJEpKiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:46 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:46 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:46 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16c36d6-2a2e-4bea-b659-5262ce4f275c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:59:46 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[336c662b-e03e-4f6e-be3a-51c283d4d509]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d] added
Aug 17 19:59:46 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7f99ee-23ce-47eb-a35d-2c96b817ca83]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c207336e-81f1-4ea0-863a-95b3566b148a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PIJEpKiY {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PIJEpKiY" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[525c1b15-bc33-4e83-947a-b83b2baa854c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PIJEpKiY'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[691aa675-e5f7-464c-bee2-79e74a17a72e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3345c99f-605d-460a-92f5-09486cf96a03]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 19:59:46 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 19:59:46 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c9b6ba-2fc6-4755-b956-ddcf30219676]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d, portal: 172.16.0.220,3260]
Aug 17 19:59:46 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d, portal: 172.16.0.220,3260] successful.
Aug 17 19:59:46 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b156967c-49db-41de-95eb-344bc1590e5a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ec63a3-03a7-4d91-98b5-8e9b78df96d0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 19:59:46 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 19:59:46 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 19:59:46 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.040s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[31089789-503a-4a2c-92da-a4e249215a8e]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIJEpKiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-98a0b9b4-4cee-448f-a623-f0faa0c6ced3 req-fd0d4b30-8359-4900-96c7-bcec25dfcd19 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-98a0b9b4-4cee-448f-a623-f0faa0c6ced3 req-fd0d4b30-8359-4900-96c7-bcec25dfcd19 service nova] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-98a0b9b4-4cee-448f-a623-f0faa0c6ced3 req-fd0d4b30-8359-4900-96c7-bcec25dfcd19 service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-98a0b9b4-4cee-448f-a623-f0faa0c6ced3 req-fd0d4b30-8359-4900-96c7-bcec25dfcd19 service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-98a0b9b4-4cee-448f-a623-f0faa0c6ced3 req-fd0d4b30-8359-4900-96c7-bcec25dfcd19 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] No waiting events found dispatching network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:46 user nova-compute[72815]: WARNING nova.compute.manager [req-98a0b9b4-4cee-448f-a623-f0faa0c6ced3 req-fd0d4b30-8359-4900-96c7-bcec25dfcd19 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received unexpected event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e for instance with vm_state stopped and task_state None.
Aug 17 19:59:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23131303136383132', 'path': '/dev/sdf'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131303136383132', 'path': '/dev/sdf'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:f1:21,bridge_name='br-int',has_traffic_filtering=True,id=431a8b0e-fe6d-4805-9456-7a75a9cc7efe,network=Network(6f15f961-c367-400e-9099-e88fe115c67f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431a8b0e-fe') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:ea,bridge_name='br-int',has_traffic_filtering=True,id=2730732d-913e-4e70-b1ac-69acd53e9bac,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2730732d-91') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:10:68,bridge_name='br-int',has_traffic_filtering=True,id=8cb05478-e8f0-4130-9263-89b3b569bf41,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8cb05478-e8') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "address": "fa:16:3e:26:ef:49", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22dad22-87", "ovs_interfaceid": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "address": "fa:16:3e:26:ef:49", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22dad22-87", "ovs_interfaceid": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ef:49,bridge_name='br-int',has_traffic_filtering=True,id=a22dad22-87fa-4b9c-866a-6c4c29c2d1b2,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22dad22-87') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:dc:44,bridge_name='br-int',has_traffic_filtering=True,id=2f92bde6-dd64-4c9c-b317-75cb5f984cc3,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92bde6-dd') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1ace327-2298-4cd7-b9ae-40656e87871b", "address": "fa:16:3e:d7:d5:73", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace327-22", "ovs_interfaceid": "c1ace327-2298-4cd7-b9ae-40656e87871b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "c1ace327-2298-4cd7-b9ae-40656e87871b", "address": "fa:16:3e:d7:d5:73", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace327-22", "ovs_interfaceid": "c1ace327-2298-4cd7-b9ae-40656e87871b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=c1ace327-2298-4cd7-b9ae-40656e87871b,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace327-22') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:9a:61,bridge_name='br-int',has_traffic_filtering=True,id=55be58dc-83ce-4144-b1f2-b18d8750e613,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55be58dc-83') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.objects.instance [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lazy-loading 'pci_devices' on Instance uuid 03a874db-ce51-4502-839d-7cf9ff2f9259 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:59:47 user nova-compute[72815]:   <uuid>03a874db-ce51-4502-839d-7cf9ff2f9259</uuid>
Aug 17 19:59:47 user nova-compute[72815]:   <name>instance-00000012</name>
Aug 17 19:59:47 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:59:47 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:59:47 user nova-compute[72815]:   <metadata>
Aug 17 19:59:47 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:59:47 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:59:47 user nova-compute[72815]:       <nova:name>tempest-device-tagging-server-338351860</nova:name>
Aug 17 19:59:47 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:59:43</nova:creationTime>
Aug 17 19:59:47 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:59:47 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:59:47 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:59:47 user nova-compute[72815]:       <nova:owner>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:user uuid="437d3bc2718d43d190e10a0c170cd889">tempest-TaggedBootDevicesTest_v242-69187056-project-member</nova:user>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:project uuid="a2f87cb80bdf4526972d9466d518b922">tempest-TaggedBootDevicesTest_v242-69187056</nova:project>
Aug 17 19:59:47 user nova-compute[72815]:       </nova:owner>
Aug 17 19:59:47 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:59:47 user nova-compute[72815]:       <nova:ports>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:port uuid="431a8b0e-fe6d-4805-9456-7a75a9cc7efe">
Aug 17 19:59:47 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 19:59:47 user nova-compute[72815]:         </nova:port>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:port uuid="2730732d-913e-4e70-b1ac-69acd53e9bac">
Aug 17 19:59:47 user nova-compute[72815]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Aug 17 19:59:47 user nova-compute[72815]:         </nova:port>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:port uuid="8cb05478-e8f0-4130-9263-89b3b569bf41">
Aug 17 19:59:47 user nova-compute[72815]:           <nova:ip type="fixed" address="10.1.1.16" ipVersion="4"/>
Aug 17 19:59:47 user nova-compute[72815]:         </nova:port>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:port uuid="a22dad22-87fa-4b9c-866a-6c4c29c2d1b2">
Aug 17 19:59:47 user nova-compute[72815]:           <nova:ip type="fixed" address="10.1.1.39" ipVersion="4"/>
Aug 17 19:59:47 user nova-compute[72815]:         </nova:port>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:port uuid="2f92bde6-dd64-4c9c-b317-75cb5f984cc3">
Aug 17 19:59:47 user nova-compute[72815]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Aug 17 19:59:47 user nova-compute[72815]:         </nova:port>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:port uuid="c1ace327-2298-4cd7-b9ae-40656e87871b">
Aug 17 19:59:47 user nova-compute[72815]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 19:59:47 user nova-compute[72815]:         </nova:port>
Aug 17 19:59:47 user nova-compute[72815]:         <nova:port uuid="55be58dc-83ce-4144-b1f2-b18d8750e613">
Aug 17 19:59:47 user nova-compute[72815]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 19:59:47 user nova-compute[72815]:         </nova:port>
Aug 17 19:59:47 user nova-compute[72815]:       </nova:ports>
Aug 17 19:59:47 user nova-compute[72815]:     </nova:instance>
Aug 17 19:59:47 user nova-compute[72815]:   </metadata>
Aug 17 19:59:47 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:59:47 user nova-compute[72815]:     <system>
Aug 17 19:59:47 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:59:47 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:59:47 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:59:47 user nova-compute[72815]:       <entry name="serial">03a874db-ce51-4502-839d-7cf9ff2f9259</entry>
Aug 17 19:59:47 user nova-compute[72815]:       <entry name="uuid">03a874db-ce51-4502-839d-7cf9ff2f9259</entry>
Aug 17 19:59:47 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:59:47 user nova-compute[72815]:     </system>
Aug 17 19:59:47 user nova-compute[72815]:   </sysinfo>
Aug 17 19:59:47 user nova-compute[72815]:   <os>
Aug 17 19:59:47 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:59:47 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:59:47 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:59:47 user nova-compute[72815]:   </os>
Aug 17 19:59:47 user nova-compute[72815]:   <features>
Aug 17 19:59:47 user nova-compute[72815]:     <acpi/>
Aug 17 19:59:47 user nova-compute[72815]:     <apic/>
Aug 17 19:59:47 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:59:47 user nova-compute[72815]:   </features>
Aug 17 19:59:47 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:59:47 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:59:47 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:59:47 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:59:47 user nova-compute[72815]:   </clock>
Aug 17 19:59:47 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:59:47 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:59:47 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:59:47 user nova-compute[72815]:   </cpu>
Aug 17 19:59:47 user nova-compute[72815]:   <devices>
Aug 17 19:59:47 user nova-compute[72815]:     <disk type="file" device="cdrom">
Aug 17 19:59:47 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 19:59:47 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/03a874db-ce51-4502-839d-7cf9ff2f9259/disk.config"/>
Aug 17 19:59:47 user nova-compute[72815]:       <target dev="hda" bus="ide"/>
Aug 17 19:59:47 user nova-compute[72815]:     </disk>
Aug 17 19:59:47 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 19:59:47 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:59:47 user nova-compute[72815]:       <source dev="/dev/sdb"/>
Aug 17 19:59:47 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:59:47 user nova-compute[72815]:       <serial>fa3094f0-c65a-4888-8928-93bd3dcc63fe</serial>
Aug 17 19:59:47 user nova-compute[72815]:     </disk>
Aug 17 19:59:47 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 19:59:47 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:59:47 user nova-compute[72815]:       <source dev="/dev/sde"/>
Aug 17 19:59:47 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 19:59:47 user nova-compute[72815]:       <serial>7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae</serial>
Aug 17 19:59:47 user nova-compute[72815]:     </disk>
Aug 17 19:59:47 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 19:59:47 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:59:47 user nova-compute[72815]:       <source dev="/dev/sdf"/>
Aug 17 19:59:47 user nova-compute[72815]:       <target dev="vdc" bus="virtio"/>
Aug 17 19:59:47 user nova-compute[72815]:       <serial>443cbc27-a597-4636-8ae6-31f8cc49009d</serial>
Aug 17 19:59:47 user nova-compute[72815]:     </disk>
Aug 17 19:59:47 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:59:47 user nova-compute[72815]:       <mac address="fa:16:3e:c8:f1:21"/>
Aug 17 19:59:47 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:47 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:59:47 user nova-compute[72815]:       <target dev="tap431a8b0e-fe"/>
Aug 17 19:59:47 user nova-compute[72815]:     </interface>
Aug 17 19:59:47 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:59:47 user nova-compute[72815]:       <mac address="fa:16:3e:3c:c4:ea"/>
Aug 17 19:59:47 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:47 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:59:47 user nova-compute[72815]:       <target dev="tap2730732d-91"/>
Aug 17 19:59:47 user nova-compute[72815]:     </interface>
Aug 17 19:59:47 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:59:47 user nova-compute[72815]:       <mac address="fa:16:3e:ce:10:68"/>
Aug 17 19:59:47 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:47 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:59:47 user nova-compute[72815]:       <target dev="tap8cb05478-e8"/>
Aug 17 19:59:47 user nova-compute[72815]:     </interface>
Aug 17 19:59:47 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:59:47 user nova-compute[72815]:       <mac address="fa:16:3e:26:ef:49"/>
Aug 17 19:59:47 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:47 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:59:47 user nova-compute[72815]:       <target dev="tapa22dad22-87"/>
Aug 17 19:59:47 user nova-compute[72815]:     </interface>
Aug 17 19:59:47 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:59:47 user nova-compute[72815]:       <mac address="fa:16:3e:19:dc:44"/>
Aug 17 19:59:47 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:47 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:59:47 user nova-compute[72815]:       <target dev="tap2f92bde6-dd"/>
Aug 17 19:59:47 user nova-compute[72815]:     </interface>
Aug 17 19:59:47 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:59:47 user nova-compute[72815]:       <mac address="fa:16:3e:d7:d5:73"/>
Aug 17 19:59:47 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:47 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:59:47 user nova-compute[72815]:       <target dev="tapc1ace327-22"/>
Aug 17 19:59:47 user nova-compute[72815]:     </interface>
Aug 17 19:59:47 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:59:47 user nova-compute[72815]:       <mac address="fa:16:3e:4d:9a:61"/>
Aug 17 19:59:47 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:47 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:59:47 user nova-compute[72815]:       <target dev="tap55be58dc-83"/>
Aug 17 19:59:47 user nova-compute[72815]:     </interface>
Aug 17 19:59:47 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:59:47 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/03a874db-ce51-4502-839d-7cf9ff2f9259/console.log" append="off"/>
Aug 17 19:59:47 user nova-compute[72815]:     </serial>
Aug 17 19:59:47 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:59:47 user nova-compute[72815]:     <video>
Aug 17 19:59:47 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:47 user nova-compute[72815]:     </video>
Aug 17 19:59:47 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:59:47 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:59:47 user nova-compute[72815]:     </rng>
Aug 17 19:59:47 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:59:47 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:59:47 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:59:47 user nova-compute[72815]:     </memballoon>
Aug 17 19:59:47 user nova-compute[72815]:   </devices>
Aug 17 19:59:47 user nova-compute[72815]: </domain>
Aug 17 19:59:47 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:f1:21,bridge_name='br-int',has_traffic_filtering=True,id=431a8b0e-fe6d-4805-9456-7a75a9cc7efe,network=Network(6f15f961-c367-400e-9099-e88fe115c67f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431a8b0e-fe') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:f1:21,bridge_name='br-int',has_traffic_filtering=True,id=431a8b0e-fe6d-4805-9456-7a75a9cc7efe,network=Network(6f15f961-c367-400e-9099-e88fe115c67f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431a8b0e-fe') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap431a8b0e-fe, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap431a8b0e-fe, col_values=(('external_ids', {'iface-id': '431a8b0e-fe6d-4805-9456-7a75a9cc7efe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:f1:21', 'vm-uuid': '03a874db-ce51-4502-839d-7cf9ff2f9259'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: INFO os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:f1:21,bridge_name='br-int',has_traffic_filtering=True,id=431a8b0e-fe6d-4805-9456-7a75a9cc7efe,network=Network(6f15f961-c367-400e-9099-e88fe115c67f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431a8b0e-fe')
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:ea,bridge_name='br-int',has_traffic_filtering=True,id=2730732d-913e-4e70-b1ac-69acd53e9bac,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2730732d-91') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:ea,bridge_name='br-int',has_traffic_filtering=True,id=2730732d-913e-4e70-b1ac-69acd53e9bac,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2730732d-91') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2730732d-91, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2730732d-91, col_values=(('external_ids', {'iface-id': '2730732d-913e-4e70-b1ac-69acd53e9bac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:c4:ea', 'vm-uuid': '03a874db-ce51-4502-839d-7cf9ff2f9259'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: INFO os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:ea,bridge_name='br-int',has_traffic_filtering=True,id=2730732d-913e-4e70-b1ac-69acd53e9bac,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2730732d-91')
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:10:68,bridge_name='br-int',has_traffic_filtering=True,id=8cb05478-e8f0-4130-9263-89b3b569bf41,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8cb05478-e8') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:10:68,bridge_name='br-int',has_traffic_filtering=True,id=8cb05478-e8f0-4130-9263-89b3b569bf41,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8cb05478-e8') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cb05478-e8, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8cb05478-e8, col_values=(('external_ids', {'iface-id': '8cb05478-e8f0-4130-9263-89b3b569bf41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:10:68', 'vm-uuid': '03a874db-ce51-4502-839d-7cf9ff2f9259'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: INFO os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:10:68,bridge_name='br-int',has_traffic_filtering=True,id=8cb05478-e8f0-4130-9263-89b3b569bf41,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8cb05478-e8')
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "address": "fa:16:3e:26:ef:49", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22dad22-87", "ovs_interfaceid": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "address": "fa:16:3e:26:ef:49", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22dad22-87", "ovs_interfaceid": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ef:49,bridge_name='br-int',has_traffic_filtering=True,id=a22dad22-87fa-4b9c-866a-6c4c29c2d1b2,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22dad22-87') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ef:49,bridge_name='br-int',has_traffic_filtering=True,id=a22dad22-87fa-4b9c-866a-6c4c29c2d1b2,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22dad22-87') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa22dad22-87, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa22dad22-87, col_values=(('external_ids', {'iface-id': 'a22dad22-87fa-4b9c-866a-6c4c29c2d1b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:ef:49', 'vm-uuid': '03a874db-ce51-4502-839d-7cf9ff2f9259'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: INFO os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ef:49,bridge_name='br-int',has_traffic_filtering=True,id=a22dad22-87fa-4b9c-866a-6c4c29c2d1b2,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22dad22-87')
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:dc:44,bridge_name='br-int',has_traffic_filtering=True,id=2f92bde6-dd64-4c9c-b317-75cb5f984cc3,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92bde6-dd') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:dc:44,bridge_name='br-int',has_traffic_filtering=True,id=2f92bde6-dd64-4c9c-b317-75cb5f984cc3,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92bde6-dd') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f92bde6-dd, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f92bde6-dd, col_values=(('external_ids', {'iface-id': '2f92bde6-dd64-4c9c-b317-75cb5f984cc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:dc:44', 'vm-uuid': '03a874db-ce51-4502-839d-7cf9ff2f9259'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: INFO os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:dc:44,bridge_name='br-int',has_traffic_filtering=True,id=2f92bde6-dd64-4c9c-b317-75cb5f984cc3,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92bde6-dd')
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1ace327-2298-4cd7-b9ae-40656e87871b", "address": "fa:16:3e:d7:d5:73", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace327-22", "ovs_interfaceid": "c1ace327-2298-4cd7-b9ae-40656e87871b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "c1ace327-2298-4cd7-b9ae-40656e87871b", "address": "fa:16:3e:d7:d5:73", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace327-22", "ovs_interfaceid": "c1ace327-2298-4cd7-b9ae-40656e87871b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=c1ace327-2298-4cd7-b9ae-40656e87871b,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace327-22') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=c1ace327-2298-4cd7-b9ae-40656e87871b,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace327-22') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1ace327-22, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1ace327-22, col_values=(('external_ids', {'iface-id': 'c1ace327-2298-4cd7-b9ae-40656e87871b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:d5:73', 'vm-uuid': '03a874db-ce51-4502-839d-7cf9ff2f9259'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: INFO os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=c1ace327-2298-4cd7-b9ae-40656e87871b,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace327-22')
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:9a:61,bridge_name='br-int',has_traffic_filtering=True,id=55be58dc-83ce-4144-b1f2-b18d8750e613,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55be58dc-83') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:9a:61,bridge_name='br-int',has_traffic_filtering=True,id=55be58dc-83ce-4144-b1f2-b18d8750e613,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55be58dc-83') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55be58dc-83, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55be58dc-83, col_values=(('external_ids', {'iface-id': '55be58dc-83ce-4144-b1f2-b18d8750e613', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:9a:61', 'vm-uuid': '03a874db-ce51-4502-839d-7cf9ff2f9259'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:48 user nova-compute[72815]: INFO os_vif [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:9a:61,bridge_name='br-int',has_traffic_filtering=True,id=55be58dc-83ce-4144-b1f2-b18d8750e613,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55be58dc-83')
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] No BDM found with device name hda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] No VIF found with MAC fa:16:3e:c8:f1:21, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] No VIF found with MAC fa:16:3e:19:dc:44, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:59:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Using config drive
Aug 17 19:59:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Creating config drive at /opt/stack/data/nova/instances/03a874db-ce51-4502-839d-7cf9ff2f9259/disk.config
Aug 17 19:59:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/03a874db-ce51-4502-839d-7cf9ff2f9259/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7gts3b6d {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/03a874db-ce51-4502-839d-7cf9ff2f9259/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7gts3b6d" returned: 0 in 0.082s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:49 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302374.9337351, fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:49 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] VM Stopped (Lifecycle Event)
Aug 17 19:59:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a98697d7-1244-4913-b3c8-ca34794e9680 None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG nova.compute.manager [req-ae83ab4f-8d69-4aef-baf7-de3d7e92a0b6 req-4683e5d7-33b3-4f50-9bfa-0375679c3ee8 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ae83ab4f-8d69-4aef-baf7-de3d7e92a0b6 req-4683e5d7-33b3-4f50-9bfa-0375679c3ee8 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ae83ab4f-8d69-4aef-baf7-de3d7e92a0b6 req-4683e5d7-33b3-4f50-9bfa-0375679c3ee8 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ae83ab4f-8d69-4aef-baf7-de3d7e92a0b6 req-4683e5d7-33b3-4f50-9bfa-0375679c3ee8 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG nova.compute.manager [req-ae83ab4f-8d69-4aef-baf7-de3d7e92a0b6 req-4683e5d7-33b3-4f50-9bfa-0375679c3ee8 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:51 user nova-compute[72815]: WARNING nova.compute.manager [req-ae83ab4f-8d69-4aef-baf7-de3d7e92a0b6 req-4683e5d7-33b3-4f50-9bfa-0375679c3ee8 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-431a8b0e-fe6d-4805-9456-7a75a9cc7efe for instance with vm_state building and task_state spawning.
Aug 17 19:59:51 user nova-compute[72815]: DEBUG nova.compute.manager [req-2526cfef-8fde-4b43-bb46-3221869c8a23 req-5ba704a5-5001-4cf6-a302-b7876adfbea4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-2730732d-913e-4e70-b1ac-69acd53e9bac {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2526cfef-8fde-4b43-bb46-3221869c8a23 req-5ba704a5-5001-4cf6-a302-b7876adfbea4 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2526cfef-8fde-4b43-bb46-3221869c8a23 req-5ba704a5-5001-4cf6-a302-b7876adfbea4 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2526cfef-8fde-4b43-bb46-3221869c8a23 req-5ba704a5-5001-4cf6-a302-b7876adfbea4 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG nova.compute.manager [req-2526cfef-8fde-4b43-bb46-3221869c8a23 req-5ba704a5-5001-4cf6-a302-b7876adfbea4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-2730732d-913e-4e70-b1ac-69acd53e9bac {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:51 user nova-compute[72815]: WARNING nova.compute.manager [req-2526cfef-8fde-4b43-bb46-3221869c8a23 req-5ba704a5-5001-4cf6-a302-b7876adfbea4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-2730732d-913e-4e70-b1ac-69acd53e9bac for instance with vm_state building and task_state spawning.
Aug 17 19:59:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG nova.compute.manager [req-0f46b331-1c37-47af-a2bd-2bc14e9a2b99 req-e6c6bebb-1db7-4c45-90db-d4ecf393cbb9 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-8cb05478-e8f0-4130-9263-89b3b569bf41 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0f46b331-1c37-47af-a2bd-2bc14e9a2b99 req-e6c6bebb-1db7-4c45-90db-d4ecf393cbb9 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0f46b331-1c37-47af-a2bd-2bc14e9a2b99 req-e6c6bebb-1db7-4c45-90db-d4ecf393cbb9 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.021s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0f46b331-1c37-47af-a2bd-2bc14e9a2b99 req-e6c6bebb-1db7-4c45-90db-d4ecf393cbb9 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG nova.compute.manager [req-0f46b331-1c37-47af-a2bd-2bc14e9a2b99 req-e6c6bebb-1db7-4c45-90db-d4ecf393cbb9 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-8cb05478-e8f0-4130-9263-89b3b569bf41 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:51 user nova-compute[72815]: WARNING nova.compute.manager [req-0f46b331-1c37-47af-a2bd-2bc14e9a2b99 req-e6c6bebb-1db7-4c45-90db-d4ecf393cbb9 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-8cb05478-e8f0-4130-9263-89b3b569bf41 for instance with vm_state building and task_state spawning.
Aug 17 19:59:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:59:53 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Creating image(s)
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "/opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "/opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.246s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:53 user nova-compute[72815]: WARNING nova.compute.manager [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-431a8b0e-fe6d-4805-9456-7a75a9cc7efe for instance with vm_state building and task_state spawning.
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:53 user nova-compute[72815]: WARNING nova.compute.manager [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-c1ace327-2298-4cd7-b9ae-40656e87871b for instance with vm_state building and task_state spawning.
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:53 user nova-compute[72815]: WARNING nova.compute.manager [req-75d5ae7e-5d82-4fe6-acc6-702b99e33913 req-1f7e57f3-1e19-4000-b34f-4f9021285272 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-c1ace327-2298-4cd7-b9ae-40656e87871b for instance with vm_state building and task_state spawning.
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.237s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-64a0b2e9-f2f2-46ed-aaa0-2436b47f9685 req-e3a2fd17-f1d2-46a3-b5db-5dfb99158ecc service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-2730732d-913e-4e70-b1ac-69acd53e9bac {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-64a0b2e9-f2f2-46ed-aaa0-2436b47f9685 req-e3a2fd17-f1d2-46a3-b5db-5dfb99158ecc service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-64a0b2e9-f2f2-46ed-aaa0-2436b47f9685 req-e3a2fd17-f1d2-46a3-b5db-5dfb99158ecc service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-64a0b2e9-f2f2-46ed-aaa0-2436b47f9685 req-e3a2fd17-f1d2-46a3-b5db-5dfb99158ecc service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-64a0b2e9-f2f2-46ed-aaa0-2436b47f9685 req-e3a2fd17-f1d2-46a3-b5db-5dfb99158ecc service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-2730732d-913e-4e70-b1ac-69acd53e9bac {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:53 user nova-compute[72815]: WARNING nova.compute.manager [req-64a0b2e9-f2f2-46ed-aaa0-2436b47f9685 req-e3a2fd17-f1d2-46a3-b5db-5dfb99158ecc service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-2730732d-913e-4e70-b1ac-69acd53e9bac for instance with vm_state building and task_state spawning.
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk 1073741824" returned: 0 in 0.066s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-8cb05478-e8f0-4130-9263-89b3b569bf41 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-8cb05478-e8f0-4130-9263-89b3b569bf41 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:53 user nova-compute[72815]: WARNING nova.compute.manager [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-8cb05478-e8f0-4130-9263-89b3b569bf41 for instance with vm_state building and task_state spawning.
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:53 user nova-compute[72815]: WARNING nova.compute.manager [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 for instance with vm_state building and task_state spawning.
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:53 user nova-compute[72815]: WARNING nova.compute.manager [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 for instance with vm_state building and task_state spawning.
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:53 user nova-compute[72815]: WARNING nova.compute.manager [req-09cf1932-5536-43d3-9342-71ecca0bcad6 req-ee222d3a-9027-4ed6-b17e-1041e631ded6 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 for instance with vm_state building and task_state spawning.
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.222s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:59:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.456s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Cannot resize image /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Ensure instance console log exists: /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Start _get_guest_xml network_info=[{"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': '373180fe-add0-4fac-9169-97a184e64398', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRdiENpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0', 'attached_at': '', 'detached_at': '', 'volume_id': 'c500c537-a5a5-45c9-9d49-de565adcbbf0', 'serial': 'c500c537-a5a5-45c9-9d49-de565adcbbf0'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:59:54 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 19:59:54 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'vcpu_model' on Instance uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRdiENpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:59:54 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:54 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:59:54 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbbcd87-2084-4ba3-b6e1-b6329b28305a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:59:54 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c875c5a8-566c-4df9-8174-a4702e69fca1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0] added
Aug 17 19:59:54 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60aebd7-bfd0-4608-a056-6f51c6545b85]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb590f5-ef6d-4f3d-8982-e836ef66b065]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRdiENpD {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRdiENpD" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ce8044-6190-49ce-bfa0-4e8676825cb6]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YRdiENpD'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8d6579-4da9-4247-9d25-d9bc949d333e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dbcf8a-a264-431c-8788-128d30a9c463]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 19:59:54 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 19:59:54 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb52465-2e27-4d46-a002-419f00e500c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260]
Aug 17 19:59:54 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260] successful.
Aug 17 19:59:54 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b14cd8-a164-4bcd-8d78-7af3454f7f40]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2c02c1-683b-4fbb-8f17-c7b077b27821]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 19:59:54 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 19:59:54 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 19:59:54 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[309acbab-95ac-48ed-a29f-f87695e5e49c]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:59:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRdiENpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-bb8e5bd1-cec8-41bc-9c9e-b8da5d8bffe5 req-5f2b4709-0edf-4d26-a7d5-88c65be0bff4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bb8e5bd1-cec8-41bc-9c9e-b8da5d8bffe5 req-5f2b4709-0edf-4d26-a7d5-88c65be0bff4 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bb8e5bd1-cec8-41bc-9c9e-b8da5d8bffe5 req-5f2b4709-0edf-4d26-a7d5-88c65be0bff4 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bb8e5bd1-cec8-41bc-9c9e-b8da5d8bffe5 req-5f2b4709-0edf-4d26-a7d5-88c65be0bff4 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-bb8e5bd1-cec8-41bc-9c9e-b8da5d8bffe5 req-5f2b4709-0edf-4d26-a7d5-88c65be0bff4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:55 user nova-compute[72815]: WARNING nova.compute.manager [req-bb8e5bd1-cec8-41bc-9c9e-b8da5d8bffe5 req-5f2b4709-0edf-4d26-a7d5-88c65be0bff4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-55be58dc-83ce-4144-b1f2-b18d8750e613 for instance with vm_state building and task_state spawning.
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-bb8e5bd1-cec8-41bc-9c9e-b8da5d8bffe5 req-5f2b4709-0edf-4d26-a7d5-88c65be0bff4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bb8e5bd1-cec8-41bc-9c9e-b8da5d8bffe5 req-5f2b4709-0edf-4d26-a7d5-88c65be0bff4 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bb8e5bd1-cec8-41bc-9c9e-b8da5d8bffe5 req-5f2b4709-0edf-4d26-a7d5-88c65be0bff4 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bb8e5bd1-cec8-41bc-9c9e-b8da5d8bffe5 req-5f2b4709-0edf-4d26-a7d5-88c65be0bff4 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-bb8e5bd1-cec8-41bc-9c9e-b8da5d8bffe5 req-5f2b4709-0edf-4d26-a7d5-88c65be0bff4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:55 user nova-compute[72815]: WARNING nova.compute.manager [req-bb8e5bd1-cec8-41bc-9c9e-b8da5d8bffe5 req-5f2b4709-0edf-4d26-a7d5-88c65be0bff4 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-55be58dc-83ce-4144-b1f2-b18d8750e613 for instance with vm_state building and task_state spawning.
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302395.737034, 03a874db-ce51-4502-839d-7cf9ff2f9259 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:55 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] VM Resumed (Lifecycle Event)
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:59:55 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Instance spawned successfully.
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:59:55 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302395.7395997, 03a874db-ce51-4502-839d-7cf9ff2f9259 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:55 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] VM Started (Lifecycle Event)
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-548edbab-5353-4926-b40b-58787cf72b46 req-ae9d6a8a-9b55-44da-b7ca-171f8a473c96 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-548edbab-5353-4926-b40b-58787cf72b46 req-ae9d6a8a-9b55-44da-b7ca-171f8a473c96 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-548edbab-5353-4926-b40b-58787cf72b46 req-ae9d6a8a-9b55-44da-b7ca-171f8a473c96 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-548edbab-5353-4926-b40b-58787cf72b46 req-ae9d6a8a-9b55-44da-b7ca-171f8a473c96 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-548edbab-5353-4926-b40b-58787cf72b46 req-ae9d6a8a-9b55-44da-b7ca-171f8a473c96 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:55 user nova-compute[72815]: WARNING nova.compute.manager [req-548edbab-5353-4926-b40b-58787cf72b46 req-ae9d6a8a-9b55-44da-b7ca-171f8a473c96 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 for instance with vm_state building and task_state spawning.
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26263643636353862', 'path': '/dev/sdg'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263643636353862', 'path': '/dev/sdg'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:59:55 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T19:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1853215392',display_name='tempest-ServerActionsTestOtherA-server-1223347787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1853215392',id=16,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDN+itvlDzHBO+C0L5CdVVjN9zLYJQZyVMxIHI48MdeloXzEtFXvxcRexB54et5sFgI02m27W5UFXQX0FgRie2BIaKjkATT3pAVtNYbH9Q9MC8QkDr8EAwxg7wvp+8x62Q==',key_name='tempest-keypair-1413124709',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:57:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-06lrf0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:59:55 user nova-compute[72815]:   <uuid>fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0</uuid>
Aug 17 19:59:55 user nova-compute[72815]:   <name>instance-00000010</name>
Aug 17 19:59:55 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 19:59:55 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 19:59:55 user nova-compute[72815]:   <metadata>
Aug 17 19:59:55 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:59:55 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 19:59:55 user nova-compute[72815]:       <nova:name>tempest-ServerActionsTestOtherA-server-1223347787</nova:name>
Aug 17 19:59:55 user nova-compute[72815]:       <nova:creationTime>2023-08-17 19:59:54</nova:creationTime>
Aug 17 19:59:55 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 19:59:55 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 19:59:55 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 19:59:55 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 19:59:55 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:59:55 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:59:55 user nova-compute[72815]:       </nova:flavor>
Aug 17 19:59:55 user nova-compute[72815]:       <nova:owner>
Aug 17 19:59:55 user nova-compute[72815]:         <nova:user uuid="9821282c73174c448f7fca6b65676f61">tempest-ServerActionsTestOtherA-629489909-project-member</nova:user>
Aug 17 19:59:55 user nova-compute[72815]:         <nova:project uuid="a0708d4f49ed4c96b108d1d2aff76871">tempest-ServerActionsTestOtherA-629489909</nova:project>
Aug 17 19:59:55 user nova-compute[72815]:       </nova:owner>
Aug 17 19:59:55 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 19:59:55 user nova-compute[72815]:       <nova:ports>
Aug 17 19:59:55 user nova-compute[72815]:         <nova:port uuid="8efa8696-1a0f-42c7-a009-0700e77b8923">
Aug 17 19:59:55 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 19:59:55 user nova-compute[72815]:         </nova:port>
Aug 17 19:59:55 user nova-compute[72815]:       </nova:ports>
Aug 17 19:59:55 user nova-compute[72815]:     </nova:instance>
Aug 17 19:59:55 user nova-compute[72815]:   </metadata>
Aug 17 19:59:55 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 19:59:55 user nova-compute[72815]:     <system>
Aug 17 19:59:55 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:59:55 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:59:55 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 19:59:55 user nova-compute[72815]:       <entry name="serial">fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0</entry>
Aug 17 19:59:55 user nova-compute[72815]:       <entry name="uuid">fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0</entry>
Aug 17 19:59:55 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:59:55 user nova-compute[72815]:     </system>
Aug 17 19:59:55 user nova-compute[72815]:   </sysinfo>
Aug 17 19:59:55 user nova-compute[72815]:   <os>
Aug 17 19:59:55 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:59:55 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 19:59:55 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 19:59:55 user nova-compute[72815]:   </os>
Aug 17 19:59:55 user nova-compute[72815]:   <features>
Aug 17 19:59:55 user nova-compute[72815]:     <acpi/>
Aug 17 19:59:55 user nova-compute[72815]:     <apic/>
Aug 17 19:59:55 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 19:59:55 user nova-compute[72815]:   </features>
Aug 17 19:59:55 user nova-compute[72815]:   <clock offset="utc">
Aug 17 19:59:55 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:59:55 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:59:55 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 19:59:55 user nova-compute[72815]:   </clock>
Aug 17 19:59:55 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 19:59:55 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 19:59:55 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:59:55 user nova-compute[72815]:   </cpu>
Aug 17 19:59:55 user nova-compute[72815]:   <devices>
Aug 17 19:59:55 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 19:59:55 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:59:55 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk"/>
Aug 17 19:59:55 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 19:59:55 user nova-compute[72815]:     </disk>
Aug 17 19:59:55 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 19:59:55 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:59:55 user nova-compute[72815]:       <source dev="/dev/sdg"/>
Aug 17 19:59:55 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 19:59:55 user nova-compute[72815]:       <serial>c500c537-a5a5-45c9-9d49-de565adcbbf0</serial>
Aug 17 19:59:55 user nova-compute[72815]:     </disk>
Aug 17 19:59:55 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 19:59:55 user nova-compute[72815]:       <mac address="fa:16:3e:e8:55:36"/>
Aug 17 19:59:55 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:55 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 19:59:55 user nova-compute[72815]:       <target dev="tap8efa8696-1a"/>
Aug 17 19:59:55 user nova-compute[72815]:     </interface>
Aug 17 19:59:55 user nova-compute[72815]:     <serial type="pty">
Aug 17 19:59:55 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/console.log" append="off"/>
Aug 17 19:59:55 user nova-compute[72815]:     </serial>
Aug 17 19:59:55 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:59:55 user nova-compute[72815]:     <video>
Aug 17 19:59:55 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 19:59:55 user nova-compute[72815]:     </video>
Aug 17 19:59:55 user nova-compute[72815]:     <rng model="virtio">
Aug 17 19:59:55 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:59:55 user nova-compute[72815]:     </rng>
Aug 17 19:59:55 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:59:55 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 19:59:55 user nova-compute[72815]:       <stats period="10"/>
Aug 17 19:59:55 user nova-compute[72815]:     </memballoon>
Aug 17 19:59:55 user nova-compute[72815]:   </devices>
Aug 17 19:59:55 user nova-compute[72815]: </domain>
Aug 17 19:59:55 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T19:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1853215392',display_name='tempest-ServerActionsTestOtherA-server-1223347787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1853215392',id=16,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDN+itvlDzHBO+C0L5CdVVjN9zLYJQZyVMxIHI48MdeloXzEtFXvxcRexB54et5sFgI02m27W5UFXQX0FgRie2BIaKjkATT3pAVtNYbH9Q9MC8QkDr8EAwxg7wvp+8x62Q==',key_name='tempest-keypair-1413124709',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:57:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-06lrf0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG os_vif [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8efa8696-1a, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8efa8696-1a, col_values=(('external_ids', {'iface-id': '8efa8696-1a0f-42c7-a009-0700e77b8923', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:55:36', 'vm-uuid': 'fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:55 user nova-compute[72815]: INFO nova.compute.manager [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Took 12.55 seconds to spawn the instance on the hypervisor.
Aug 17 19:59:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:59:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:56 user nova-compute[72815]: INFO os_vif [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a')
Aug 17 19:59:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:56 user nova-compute[72815]: INFO nova.compute.manager [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Took 55.95 seconds to build instance.
Aug 17 19:59:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:59:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:59:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No VIF found with MAC fa:16:3e:e8:55:36, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:59:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ce6435bc-0163-414a-a1bd-8a8c6f097fa7 tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.103s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:59:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-7df5abfc-6365-4d46-9ae6-21dfbd844f50 req-52c0c497-de39-4c7b-b0b7-ac67ca721ccf service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received event network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7df5abfc-6365-4d46-9ae6-21dfbd844f50 req-52c0c497-de39-4c7b-b0b7-ac67ca721ccf service nova] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7df5abfc-6365-4d46-9ae6-21dfbd844f50 req-52c0c497-de39-4c7b-b0b7-ac67ca721ccf service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7df5abfc-6365-4d46-9ae6-21dfbd844f50 req-52c0c497-de39-4c7b-b0b7-ac67ca721ccf service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-7df5abfc-6365-4d46-9ae6-21dfbd844f50 req-52c0c497-de39-4c7b-b0b7-ac67ca721ccf service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] No waiting events found dispatching network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:57 user nova-compute[72815]: WARNING nova.compute.manager [req-7df5abfc-6365-4d46-9ae6-21dfbd844f50 req-52c0c497-de39-4c7b-b0b7-ac67ca721ccf service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received unexpected event network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302399.725816, fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:59 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] VM Resumed (Lifecycle Event)
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:59:59 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Instance spawned successfully.
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:59:59 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302399.7300222, fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:59:59 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] VM Started (Lifecycle Event)
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:59:59 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72815) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.compute.manager [req-1e58a7b9-25ea-4682-903f-509239bc0845 req-887bbe03-c894-4cba-b139-548f8feece0a service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received event network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1e58a7b9-25ea-4682-903f-509239bc0845 req-887bbe03-c894-4cba-b139-548f8feece0a service nova] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1e58a7b9-25ea-4682-903f-509239bc0845 req-887bbe03-c894-4cba-b139-548f8feece0a service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1e58a7b9-25ea-4682-903f-509239bc0845 req-887bbe03-c894-4cba-b139-548f8feece0a service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:59:59 user nova-compute[72815]: DEBUG nova.compute.manager [req-1e58a7b9-25ea-4682-903f-509239bc0845 req-887bbe03-c894-4cba-b139-548f8feece0a service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] No waiting events found dispatching network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:59:59 user nova-compute[72815]: WARNING nova.compute.manager [req-1e58a7b9-25ea-4682-903f-509239bc0845 req-887bbe03-c894-4cba-b139-548f8feece0a service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received unexpected event network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 for instance with vm_state active and task_state None.
Aug 17 20:00:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7e59d8c1-62f9-4304-ac4f-d88a157ab079 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.085s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:00 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302385.3665795, 1800ab7b-dd88-45fb-9370-1b77b8cbf893 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:00:00 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] VM Stopped (Lifecycle Event)
Aug 17 20:00:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-91e1e343-a2fc-429f-810f-676c808b5760 None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:00:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-91e1e343-a2fc-429f-810f-676c808b5760 None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:00:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "969a1301-2014-4b22-8074-a0ac35136249" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "969a1301-2014-4b22-8074-a0ac35136249" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "969a1301-2014-4b22-8074-a0ac35136249-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "969a1301-2014-4b22-8074-a0ac35136249-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "969a1301-2014-4b22-8074-a0ac35136249-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:07 user nova-compute[72815]: INFO nova.compute.manager [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Terminating instance
Aug 17 20:00:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-a3685417-0180-4435-bd45-c8935eb1e9b4 req-6dbe12ea-af44-46c5-a28a-872d0a71561f service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Received event network-vif-unplugged-71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a3685417-0180-4435-bd45-c8935eb1e9b4 req-6dbe12ea-af44-46c5-a28a-872d0a71561f service nova] Acquiring lock "969a1301-2014-4b22-8074-a0ac35136249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a3685417-0180-4435-bd45-c8935eb1e9b4 req-6dbe12ea-af44-46c5-a28a-872d0a71561f service nova] Lock "969a1301-2014-4b22-8074-a0ac35136249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a3685417-0180-4435-bd45-c8935eb1e9b4 req-6dbe12ea-af44-46c5-a28a-872d0a71561f service nova] Lock "969a1301-2014-4b22-8074-a0ac35136249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-a3685417-0180-4435-bd45-c8935eb1e9b4 req-6dbe12ea-af44-46c5-a28a-872d0a71561f service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] No waiting events found dispatching network-vif-unplugged-71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:00:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-a3685417-0180-4435-bd45-c8935eb1e9b4 req-6dbe12ea-af44-46c5-a28a-872d0a71561f service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Received event network-vif-unplugged-71991ae2-1663-4a4f-a0c6-ab4a271580c0 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:00:08 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Instance destroyed successfully.
Aug 17 20:00:08 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lazy-loading 'resources' on Instance uuid 969a1301-2014-4b22-8074-a0ac35136249 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1178808682',display_name='tempest-VolumesAdminNegativeTest-server-1178808682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1178808682',id=7,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPMQCVfuUWmUlftiTIms4TWB5EFRLzDImOgY7ed4m4FFkwrp+11w0GzZ+hT5llRfeDVKIKvS9LTPCcTBkyfcHyNgHe/HpVqAJCmvaW67RMfdrrMjpN0Iqi5XijoTuLBLg==',key_name='tempest-keypair-141777476',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:54:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f619f5dec7704081974d9a757c392090',ramdisk_id='',reservation_id='r-1leqk0cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-380028141',owner_user_name='tempest-VolumesAdminNegativeTest-380028141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:54:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f92e9d1656b4677bc1539c279e60450',uuid=969a1301-2014-4b22-8074-a0ac35136249,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "address": "fa:16:3e:e1:b7:04", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71991ae2-16", "ovs_interfaceid": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:00:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Converting VIF {"id": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "address": "fa:16:3e:e1:b7:04", "network": {"id": "e5ad46db-0278-48de-be5e-8ec5270d8a83", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500556801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f619f5dec7704081974d9a757c392090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71991ae2-16", "ovs_interfaceid": "71991ae2-1663-4a4f-a0c6-ab4a271580c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:00:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:b7:04,bridge_name='br-int',has_traffic_filtering=True,id=71991ae2-1663-4a4f-a0c6-ab4a271580c0,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71991ae2-16') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:00:08 user nova-compute[72815]: DEBUG os_vif [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:b7:04,bridge_name='br-int',has_traffic_filtering=True,id=71991ae2-1663-4a4f-a0c6-ab4a271580c0,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71991ae2-16') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:00:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71991ae2-16, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:00:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:00:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:08 user nova-compute[72815]: INFO os_vif [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:b7:04,bridge_name='br-int',has_traffic_filtering=True,id=71991ae2-1663-4a4f-a0c6-ab4a271580c0,network=Network(e5ad46db-0278-48de-be5e-8ec5270d8a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71991ae2-16')
Aug 17 20:00:08 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Deleting instance files /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249_del
Aug 17 20:00:08 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Deletion of /opt/stack/data/nova/instances/969a1301-2014-4b22-8074-a0ac35136249_del complete
Aug 17 20:00:08 user nova-compute[72815]: INFO nova.compute.manager [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 17 20:00:08 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:00:08 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:00:08 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 969a1301-2014-4b22-8074-a0ac35136249] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:00:09 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Took 1.06 seconds to deallocate network for instance.
Aug 17 20:00:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-47d14d02-a3f4-4dd7-aaf8-a610c8cfc6ce req-491a970d-243f-45b5-b1ef-f67173def3f5 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Received event network-vif-deleted-71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:09 user nova-compute[72815]: INFO nova.compute.manager [req-47d14d02-a3f4-4dd7-aaf8-a610c8cfc6ce req-491a970d-243f-45b5-b1ef-f67173def3f5 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Neutron deleted interface 71991ae2-1663-4a4f-a0c6-ab4a271580c0; detaching it from the instance and deleting it from the info cache
Aug 17 20:00:09 user nova-compute[72815]: DEBUG nova.network.neutron [req-47d14d02-a3f4-4dd7-aaf8-a610c8cfc6ce req-491a970d-243f-45b5-b1ef-f67173def3f5 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-47d14d02-a3f4-4dd7-aaf8-a610c8cfc6ce req-491a970d-243f-45b5-b1ef-f67173def3f5 service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Detach interface failed, port_id=71991ae2-1663-4a4f-a0c6-ab4a271580c0, reason: Instance 969a1301-2014-4b22-8074-a0ac35136249 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:09 user nova-compute[72815]: INFO nova.compute.manager [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Detaching volume bb5ada6a-3d44-40ce-a284-cc2da9e35d06
Aug 17 20:00:09 user nova-compute[72815]: INFO nova.virt.block_device [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Attempting to driver detach volume bb5ada6a-3d44-40ce-a284-cc2da9e35d06 from mountpoint /dev/vdb
Aug 17 20:00:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-c9b58e51-3b22-45e2-91e8-7e46c6422a62 req-0903d8d2-6c84-4e09-8cc0-450cb8287c9e service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Received event network-vif-plugged-71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c9b58e51-3b22-45e2-91e8-7e46c6422a62 req-0903d8d2-6c84-4e09-8cc0-450cb8287c9e service nova] Acquiring lock "969a1301-2014-4b22-8074-a0ac35136249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c9b58e51-3b22-45e2-91e8-7e46c6422a62 req-0903d8d2-6c84-4e09-8cc0-450cb8287c9e service nova] Lock "969a1301-2014-4b22-8074-a0ac35136249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c9b58e51-3b22-45e2-91e8-7e46c6422a62 req-0903d8d2-6c84-4e09-8cc0-450cb8287c9e service nova] Lock "969a1301-2014-4b22-8074-a0ac35136249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-c9b58e51-3b22-45e2-91e8-7e46c6422a62 req-0903d8d2-6c84-4e09-8cc0-450cb8287c9e service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] No waiting events found dispatching network-vif-plugged-71991ae2-1663-4a4f-a0c6-ab4a271580c0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:00:09 user nova-compute[72815]: WARNING nova.compute.manager [req-c9b58e51-3b22-45e2-91e8-7e46c6422a62 req-0903d8d2-6c84-4e09-8cc0-450cb8287c9e service nova] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Received unexpected event network-vif-plugged-71991ae2-1663-4a4f-a0c6-ab4a271580c0 for instance with vm_state deleted and task_state None.
Aug 17 20:00:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Attempting to detach device vdb from instance 07d46763-1b59-4cce-9e10-e94d0efea05d from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:00:09 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:00:09 user nova-compute[72815]:   <source dev="/dev/sdd"/>
Aug 17 20:00:09 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:00:09 user nova-compute[72815]:   <serial>bb5ada6a-3d44-40ce-a284-cc2da9e35d06</serial>
Aug 17 20:00:09 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:00:09 user nova-compute[72815]: </disk>
Aug 17 20:00:09 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:00:09 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Successfully detached device vdb from instance 07d46763-1b59-4cce-9e10-e94d0efea05d from the persistent domain config.
Aug 17 20:00:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07d46763-1b59-4cce-9e10-e94d0efea05d from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:00:09 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:00:09 user nova-compute[72815]:   <source dev="/dev/sdd"/>
Aug 17 20:00:09 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:00:09 user nova-compute[72815]:   <serial>bb5ada6a-3d44-40ce-a284-cc2da9e35d06</serial>
Aug 17 20:00:09 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:00:09 user nova-compute[72815]: </disk>
Aug 17 20:00:09 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:09 user nova-compute[72815]: INFO nova.compute.manager [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Unshelving
Aug 17 20:00:09 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:09 user nova-compute[72815]: INFO nova.virt.block_device [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Booting with volume 8cbb8fea-e52b-47ef-a807-da463a755e74 at /dev/vda
Aug 17 20:00:09 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Deleted allocations for instance 969a1301-2014-4b22-8074-a0ac35136249
Aug 17 20:00:09 user nova-compute[72815]: DEBUG os_brick.utils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0c63fe94-0a77-4660-b1c8-4c2745596096 tempest-VolumesAdminNegativeTest-380028141 tempest-VolumesAdminNegativeTest-380028141-project-member] Lock "969a1301-2014-4b22-8074-a0ac35136249" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.843s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[721359be-4aa4-42c4-ad46-bd84f0bd4308]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eae3ce7-e320-49da-8cbf-060256a69e9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[85144a72-5b74-44d5-93b8-53f309e2685b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b17c78-0c9f-41aa-9f4c-dadd853bf5c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302410.0792885, 07d46763-1b59-4cce-9e10-e94d0efea05d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Successfully detached device vdb from instance 07d46763-1b59-4cce-9e10-e94d0efea05d from the live domain config.
Aug 17 20:00:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVRnfvcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:00:10 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:00:10 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5536b5-b4fa-4235-9a87-f93095de2060]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.utils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updating existing volume attachment record: e4c2351c-6532-490c-800b-7160617c0ab4 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9969204f-6f0e-48ba-a2cb-e31fc5bcb03e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f58a1f-af19-4b7a-8013-b1e36c24e829]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:00:10 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 20:00:10 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:00:10 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:00:10 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:00:10 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:00:10 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:00:10 user nova-compute[72815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 (non-flash)
Aug 17 20:00:10 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:00:10 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:00:10 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:00:10 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:00:10 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994348f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06'): ({'sdd'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Removing single pathed devices sdd {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[304a3ea9-10ba-45aa-9742-1e1dbfd8de8e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce713811-6f5b-4dfb-8ddb-9147767b0e89]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Flushing IO for device /dev/sdd {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e80041c-30ed-42d0-8850-b253afaf0e45]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b847477-1f7b-4f24-b1e4-702f3f4f337e]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e30c8d-a190-452d-8c10-92a27e44214e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5e7f94-1701-498d-b292-a32629b3a4f9]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06, portal: 172.16.0.220,3260]
Aug 17 20:00:10 user nova-compute[72815]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06, portal: 172.16.0.220,3260] successful.
Aug 17 20:00:10 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5ada6a-3d44-40ce-a284-cc2da9e35d06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54f2a13-f767-4e89-ae28-29b5630916b9]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] <== disconnect_volume: return (340ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:00:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:00:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:11 user nova-compute[72815]: DEBUG nova.objects.instance [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'flavor' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4043ee5e-65e2-4166-9b7b-de8d13478ae5 tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.911s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:12 user nova-compute[72815]: INFO nova.compute.manager [None req-1583f6f2-9ece-4a99-b2a5-ed95278f8ba2 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Unrescuing
Aug 17 20:00:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1583f6f2-9ece-4a99-b2a5-ed95278f8ba2 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:00:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1583f6f2-9ece-4a99-b2a5-ed95278f8ba2 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquired lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:00:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-1583f6f2-9ece-4a99-b2a5-ed95278f8ba2 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:00:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-1583f6f2-9ece-4a99-b2a5-ed95278f8ba2 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Updating instance_info_cache with network_info: [{"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:00:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1583f6f2-9ece-4a99-b2a5-ed95278f8ba2 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Releasing lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:00:13 user nova-compute[72815]: DEBUG nova.objects.instance [None req-1583f6f2-9ece-4a99-b2a5-ed95278f8ba2 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'flavor' on Instance uuid ac6faff5-9700-4504-81d8-8ba2ab64d85f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-25300937-fb83-4687-8a70-9f128d27b437 req-ed3e4ba2-fa7f-4670-90cc-18c3ff8dfcda service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-unplugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-25300937-fb83-4687-8a70-9f128d27b437 req-ed3e4ba2-fa7f-4670-90cc-18c3ff8dfcda service nova] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-25300937-fb83-4687-8a70-9f128d27b437 req-ed3e4ba2-fa7f-4670-90cc-18c3ff8dfcda service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-25300937-fb83-4687-8a70-9f128d27b437 req-ed3e4ba2-fa7f-4670-90cc-18c3ff8dfcda service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-25300937-fb83-4687-8a70-9f128d27b437 req-ed3e4ba2-fa7f-4670-90cc-18c3ff8dfcda service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] No waiting events found dispatching network-vif-unplugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:00:13 user nova-compute[72815]: WARNING nova.compute.manager [req-25300937-fb83-4687-8a70-9f128d27b437 req-ed3e4ba2-fa7f-4670-90cc-18c3ff8dfcda service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received unexpected event network-vif-unplugged-682cf83c-ed24-401a-bdd4-7375f529aacb for instance with vm_state rescued and task_state unrescuing.
Aug 17 20:00:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:13 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Instance destroyed successfully.
Aug 17 20:00:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-0a402e59-f327-4af2-9dd4-1aef5251390d req-70d784a1-2877-4bd8-9b6c-a0202671be2d service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0a402e59-f327-4af2-9dd4-1aef5251390d req-70d784a1-2877-4bd8-9b6c-a0202671be2d service nova] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0a402e59-f327-4af2-9dd4-1aef5251390d req-70d784a1-2877-4bd8-9b6c-a0202671be2d service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0a402e59-f327-4af2-9dd4-1aef5251390d req-70d784a1-2877-4bd8-9b6c-a0202671be2d service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-0a402e59-f327-4af2-9dd4-1aef5251390d req-70d784a1-2877-4bd8-9b6c-a0202671be2d service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] No waiting events found dispatching network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:00:15 user nova-compute[72815]: WARNING nova.compute.manager [req-0a402e59-f327-4af2-9dd4-1aef5251390d req-70d784a1-2877-4bd8-9b6c-a0202671be2d service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received unexpected event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb for instance with vm_state rescued and task_state unrescuing.
Aug 17 20:00:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 1a714bfa-0b06-4ef8-865a-819abbc64be5 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid ab784398-43df-4214-bdd3-22c652ac710f {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 45b6365f-333f-45f1-b619-3453cbe75a88 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid ac6faff5-9700-4504-81d8-8ba2ab64d85f {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 03a874db-ce51-4502-839d-7cf9ff2f9259 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid ec0afde2-8d2b-451a-a226-be933e28ad6f {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid a5f4e2b3-6d84-418d-9109-07a4362b4d7b {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "1a714bfa-0b06-4ef8-865a-819abbc64be5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "ab784398-43df-4214-bdd3-22c652ac710f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ab784398-43df-4214-bdd3-22c652ac710f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "45b6365f-333f-45f1-b619-3453cbe75a88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "45b6365f-333f-45f1-b619-3453cbe75a88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: INFO nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: WARNING oslo_messaging._drivers.amqpdriver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ab784398-43df-4214-bdd3-22c652ac710f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "45b6365f-333f-45f1-b619-3453cbe75a88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-47b66381-65da-4416-ada7-7ecd3327cccd req-91acb11b-327d-41c7-ab5b-91ba515a342c service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47b66381-65da-4416-ada7-7ecd3327cccd req-91acb11b-327d-41c7-ab5b-91ba515a342c service nova] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47b66381-65da-4416-ada7-7ecd3327cccd req-91acb11b-327d-41c7-ab5b-91ba515a342c service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47b66381-65da-4416-ada7-7ecd3327cccd req-91acb11b-327d-41c7-ab5b-91ba515a342c service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-47b66381-65da-4416-ada7-7ecd3327cccd req-91acb11b-327d-41c7-ab5b-91ba515a342c service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] No waiting events found dispatching network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:00:17 user nova-compute[72815]: WARNING nova.compute.manager [req-47b66381-65da-4416-ada7-7ecd3327cccd req-91acb11b-327d-41c7-ab5b-91ba515a342c service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received unexpected event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb for instance with vm_state rescued and task_state unrescuing.
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-47b66381-65da-4416-ada7-7ecd3327cccd req-91acb11b-327d-41c7-ab5b-91ba515a342c service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47b66381-65da-4416-ada7-7ecd3327cccd req-91acb11b-327d-41c7-ab5b-91ba515a342c service nova] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47b66381-65da-4416-ada7-7ecd3327cccd req-91acb11b-327d-41c7-ab5b-91ba515a342c service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47b66381-65da-4416-ada7-7ecd3327cccd req-91acb11b-327d-41c7-ab5b-91ba515a342c service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-47b66381-65da-4416-ada7-7ecd3327cccd req-91acb11b-327d-41c7-ab5b-91ba515a342c service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] No waiting events found dispatching network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:00:17 user nova-compute[72815]: WARNING nova.compute.manager [req-47b66381-65da-4416-ada7-7ecd3327cccd req-91acb11b-327d-41c7-ab5b-91ba515a342c service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received unexpected event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb for instance with vm_state rescued and task_state unrescuing.
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.164s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.155s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.168s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.170s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for ac6faff5-9700-4504-81d8-8ba2ab64d85f due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302417.6600373, ac6faff5-9700-4504-81d8-8ba2ab64d85f => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:00:17 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] VM Resumed (Lifecycle Event)
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1583f6f2-9ece-4a99-b2a5-ed95278f8ba2 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:00:17 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302417.6614797, ac6faff5-9700-4504-81d8-8ba2ab64d85f => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:00:17 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] VM Started (Lifecycle Event)
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:00:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:00:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:23 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302408.094929, 969a1301-2014-4b22-8074-a0ac35136249 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:00:23 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 969a1301-2014-4b22-8074-a0ac35136249] VM Stopped (Lifecycle Event)
Aug 17 20:00:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6d6110bb-20e5-46ab-a41f-4d57be0473f6 None None] [instance: 969a1301-2014-4b22-8074-a0ac35136249] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:00:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:23 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lazy-loading 'pci_requests' on Instance uuid 541f3b1c-207c-4398-ad60-ea50e89d7327 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:23 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lazy-loading 'numa_topology' on Instance uuid 541f3b1c-207c-4398-ad60-ea50e89d7327 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:23 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:00:23 user nova-compute[72815]: INFO nova.compute.claims [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Claim successful on node user
Aug 17 20:00:23 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:00:24 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:00:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:24 user nova-compute[72815]: INFO nova.network.neutron [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updating port 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 20:00:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:00:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquired lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:00:24 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:00:24 user nova-compute[72815]: DEBUG nova.compute.manager [req-97a451f0-6a3a-4b87-b554-0e725f9e7776 req-ea87164b-0744-4f6d-bb4e-4671dd1d55e5 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-changed-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:24 user nova-compute[72815]: DEBUG nova.compute.manager [req-97a451f0-6a3a-4b87-b554-0e725f9e7776 req-ea87164b-0744-4f6d-bb4e-4671dd1d55e5 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Refreshing instance network info cache due to event network-changed-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:00:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-97a451f0-6a3a-4b87-b554-0e725f9e7776 req-ea87164b-0744-4f6d-bb4e-4671dd1d55e5 service nova] Acquiring lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updating instance_info_cache with network_info: [{"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Releasing lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:00:25 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Creating image(s)
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Ensure instance console log exists: /opt/stack/data/nova/instances/541f3b1c-207c-4398-ad60-ea50e89d7327/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Start _get_guest_xml network_info=[{"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': 'e4c2351c-6532-490c-800b-7160617c0ab4', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQLHDUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '541f3b1c-207c-4398-ad60-ea50e89d7327', 'attached_at': '', 'detached_at': '', 'volume_id': '8cbb8fea-e52b-47ef-a807-da463a755e74', 'serial': '8cbb8fea-e52b-47ef-a807-da463a755e74'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-97a451f0-6a3a-4b87-b554-0e725f9e7776 req-ea87164b-0744-4f6d-bb4e-4671dd1d55e5 service nova] Acquired lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.network.neutron [req-97a451f0-6a3a-4b87-b554-0e725f9e7776 req-ea87164b-0744-4f6d-bb4e-4671dd1d55e5 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Refreshing network info cache for port 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:00:25 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:00:25 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lazy-loading 'vcpu_model' on Instance uuid 541f3b1c-207c-4398-ad60-ea50e89d7327 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQLHDUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:00:25 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:00:25 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:00:25 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6335bfd-2009-4508-8ac6-90c8bea664d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:00:25 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dac099-b1d7-4ef4-afd6-dbce45a8661a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74] added
Aug 17 20:00:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44cbbac-fe83-4f5e-b90f-b42e321b32ab]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c58473d-6cf2-4a5d-9b80-407b21cdd203]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qrQLHDUk {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qrQLHDUk" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5ff8ab-a2a3-4834-b367-a3699854955c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qrQLHDUk'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdcc450-65c7-4e29-b05d-ad76d7095e11]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff28ad9b-a83d-42f5-8ba3-cf9b66261465]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:00:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:00:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee0adfd-4686-4565-8c7b-c99016cb11a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260]
Aug 17 20:00:25 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260] successful.
Aug 17 20:00:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c87948-47b7-4af4-a1ee-2905b4db6448]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1896b9c6-5d3c-45a7-aa28-8157f3e5be85]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:00:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:00:25 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:00:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3883f8d0-7766-4a55-a0a0-2d749a84b5d4]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQLHDUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.network.neutron [req-97a451f0-6a3a-4b87-b554-0e725f9e7776 req-ea87164b-0744-4f6d-bb4e-4671dd1d55e5 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updated VIF entry in instance network info cache for port 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG nova.network.neutron [req-97a451f0-6a3a-4b87-b554-0e725f9e7776 req-ea87164b-0744-4f6d-bb4e-4671dd1d55e5 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updating instance_info_cache with network_info: [{"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:00:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-97a451f0-6a3a-4b87-b554-0e725f9e7776 req-ea87164b-0744-4f6d-bb4e-4671dd1d55e5 service nova] Releasing lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23938393032383333', 'path': '/dev/sdd'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938393032383333', 'path': '/dev/sdd'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T19:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1165123793',display_name='tempest-TestShelveInstance-server-1165123793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1165123793',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1359395454',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0e0a431d27ae4571bc0c8687e61c6fa2',ramdisk_id='',reservation_id='r-rvvq1591',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1622767385',owner_user_name='tempest-TestShelveInstance-1622767385-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:00:10Z,user_data=None,user_id='ce9def2151a447a68337ee04072fb748',uuid=541f3b1c-207c-4398-ad60-ea50e89d7327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Converting VIF {"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lazy-loading 'pci_devices' on Instance uuid 541f3b1c-207c-4398-ad60-ea50e89d7327 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:00:26 user nova-compute[72815]:   <uuid>541f3b1c-207c-4398-ad60-ea50e89d7327</uuid>
Aug 17 20:00:26 user nova-compute[72815]:   <name>instance-0000000c</name>
Aug 17 20:00:26 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:00:26 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:00:26 user nova-compute[72815]:   <metadata>
Aug 17 20:00:26 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:00:26 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:00:26 user nova-compute[72815]:       <nova:name>tempest-TestShelveInstance-server-1165123793</nova:name>
Aug 17 20:00:26 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:00:25</nova:creationTime>
Aug 17 20:00:26 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:00:26 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:00:26 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:00:26 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:00:26 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:00:26 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:00:26 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:00:26 user nova-compute[72815]:       <nova:owner>
Aug 17 20:00:26 user nova-compute[72815]:         <nova:user uuid="ce9def2151a447a68337ee04072fb748">tempest-TestShelveInstance-1622767385-project-member</nova:user>
Aug 17 20:00:26 user nova-compute[72815]:         <nova:project uuid="0e0a431d27ae4571bc0c8687e61c6fa2">tempest-TestShelveInstance-1622767385</nova:project>
Aug 17 20:00:26 user nova-compute[72815]:       </nova:owner>
Aug 17 20:00:26 user nova-compute[72815]:       <nova:ports>
Aug 17 20:00:26 user nova-compute[72815]:         <nova:port uuid="9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e">
Aug 17 20:00:26 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 20:00:26 user nova-compute[72815]:         </nova:port>
Aug 17 20:00:26 user nova-compute[72815]:       </nova:ports>
Aug 17 20:00:26 user nova-compute[72815]:     </nova:instance>
Aug 17 20:00:26 user nova-compute[72815]:   </metadata>
Aug 17 20:00:26 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:00:26 user nova-compute[72815]:     <system>
Aug 17 20:00:26 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:00:26 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:00:26 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:00:26 user nova-compute[72815]:       <entry name="serial">541f3b1c-207c-4398-ad60-ea50e89d7327</entry>
Aug 17 20:00:26 user nova-compute[72815]:       <entry name="uuid">541f3b1c-207c-4398-ad60-ea50e89d7327</entry>
Aug 17 20:00:26 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:00:26 user nova-compute[72815]:     </system>
Aug 17 20:00:26 user nova-compute[72815]:   </sysinfo>
Aug 17 20:00:26 user nova-compute[72815]:   <os>
Aug 17 20:00:26 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:00:26 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:00:26 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:00:26 user nova-compute[72815]:   </os>
Aug 17 20:00:26 user nova-compute[72815]:   <features>
Aug 17 20:00:26 user nova-compute[72815]:     <acpi/>
Aug 17 20:00:26 user nova-compute[72815]:     <apic/>
Aug 17 20:00:26 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:00:26 user nova-compute[72815]:   </features>
Aug 17 20:00:26 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:00:26 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:00:26 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:00:26 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:00:26 user nova-compute[72815]:   </clock>
Aug 17 20:00:26 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:00:26 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:00:26 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:00:26 user nova-compute[72815]:   </cpu>
Aug 17 20:00:26 user nova-compute[72815]:   <devices>
Aug 17 20:00:26 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:00:26 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:00:26 user nova-compute[72815]:       <source dev="/dev/sdd"/>
Aug 17 20:00:26 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:00:26 user nova-compute[72815]:       <serial>8cbb8fea-e52b-47ef-a807-da463a755e74</serial>
Aug 17 20:00:26 user nova-compute[72815]:     </disk>
Aug 17 20:00:26 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:00:26 user nova-compute[72815]:       <mac address="fa:16:3e:ef:8c:78"/>
Aug 17 20:00:26 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:00:26 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:00:26 user nova-compute[72815]:       <target dev="tap9dfd3fe6-63"/>
Aug 17 20:00:26 user nova-compute[72815]:     </interface>
Aug 17 20:00:26 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:00:26 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/541f3b1c-207c-4398-ad60-ea50e89d7327/console.log" append="off"/>
Aug 17 20:00:26 user nova-compute[72815]:     </serial>
Aug 17 20:00:26 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:00:26 user nova-compute[72815]:     <video>
Aug 17 20:00:26 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:00:26 user nova-compute[72815]:     </video>
Aug 17 20:00:26 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:00:26 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:00:26 user nova-compute[72815]:     </rng>
Aug 17 20:00:26 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:00:26 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:00:26 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:00:26 user nova-compute[72815]:     </memballoon>
Aug 17 20:00:26 user nova-compute[72815]:   </devices>
Aug 17 20:00:26 user nova-compute[72815]: </domain>
Aug 17 20:00:26 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T19:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1165123793',display_name='tempest-TestShelveInstance-server-1165123793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1165123793',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1359395454',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0e0a431d27ae4571bc0c8687e61c6fa2',ramdisk_id='',reservation_id='r-rvvq1591',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1622767385',owner_user_name='tempest-TestShelveInstance-1622767385-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:00:10Z,user_data=None,user_id='ce9def2151a447a68337ee04072fb748',uuid=541f3b1c-207c-4398-ad60-ea50e89d7327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Converting VIF {"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG os_vif [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dfd3fe6-63, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9dfd3fe6-63, col_values=(('external_ids', {'iface-id': '9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:8c:78', 'vm-uuid': '541f3b1c-207c-4398-ad60-ea50e89d7327'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:26 user nova-compute[72815]: INFO os_vif [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63')
Aug 17 20:00:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] No VIF found with MAC fa:16:3e:ef:8c:78, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:26 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-63fe3dc5-5f18-43d0-b3ab-a59f9ddb2ca0 req-f94d3f1a-138a-4787-a5a2-c050bafbc8d0 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-63fe3dc5-5f18-43d0-b3ab-a59f9ddb2ca0 req-f94d3f1a-138a-4787-a5a2-c050bafbc8d0 service nova] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-63fe3dc5-5f18-43d0-b3ab-a59f9ddb2ca0 req-f94d3f1a-138a-4787-a5a2-c050bafbc8d0 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-63fe3dc5-5f18-43d0-b3ab-a59f9ddb2ca0 req-f94d3f1a-138a-4787-a5a2-c050bafbc8d0 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-63fe3dc5-5f18-43d0-b3ab-a59f9ddb2ca0 req-f94d3f1a-138a-4787-a5a2-c050bafbc8d0 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] No waiting events found dispatching network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:00:28 user nova-compute[72815]: WARNING nova.compute.manager [req-63fe3dc5-5f18-43d0-b3ab-a59f9ddb2ca0 req-f94d3f1a-138a-4787-a5a2-c050bafbc8d0 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received unexpected event network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 20:00:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302430.3074293, 541f3b1c-207c-4398-ad60-ea50e89d7327 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:00:30 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] VM Resumed (Lifecycle Event)
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:00:30 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Instance spawned successfully.
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:00:30 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302430.309446, 541f3b1c-207c-4398-ad60-ea50e89d7327 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:00:30 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] VM Started (Lifecycle Event)
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bc427917-8774-48c2-ae16-3877ace643cd tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.684s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-69ae3712-454f-43dc-b85c-696efd659617 req-15606019-39ec-44f7-8fbc-78f772047728 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-69ae3712-454f-43dc-b85c-696efd659617 req-15606019-39ec-44f7-8fbc-78f772047728 service nova] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-69ae3712-454f-43dc-b85c-696efd659617 req-15606019-39ec-44f7-8fbc-78f772047728 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-69ae3712-454f-43dc-b85c-696efd659617 req-15606019-39ec-44f7-8fbc-78f772047728 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-69ae3712-454f-43dc-b85c-696efd659617 req-15606019-39ec-44f7-8fbc-78f772047728 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] No waiting events found dispatching network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:00:30 user nova-compute[72815]: WARNING nova.compute.manager [req-69ae3712-454f-43dc-b85c-696efd659617 req-15606019-39ec-44f7-8fbc-78f772047728 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received unexpected event network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e for instance with vm_state active and task_state None.
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-5b97ff6d-490e-468e-b8e0-8fc411d5d425 req-fb2be205-91c3-446a-8b89-274dafa75a42 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-changed-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-5b97ff6d-490e-468e-b8e0-8fc411d5d425 req-fb2be205-91c3-446a-8b89-274dafa75a42 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Refreshing instance network info cache due to event network-changed-b3639567-a71c-4a6c-81b5-0a04aa8800b2. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5b97ff6d-490e-468e-b8e0-8fc411d5d425 req-fb2be205-91c3-446a-8b89-274dafa75a42 service nova] Acquiring lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5b97ff6d-490e-468e-b8e0-8fc411d5d425 req-fb2be205-91c3-446a-8b89-274dafa75a42 service nova] Acquired lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG nova.network.neutron [req-5b97ff6d-490e-468e-b8e0-8fc411d5d425 req-fb2be205-91c3-446a-8b89-274dafa75a42 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Refreshing network info cache for port b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG nova.network.neutron [req-5b97ff6d-490e-468e-b8e0-8fc411d5d425 req-fb2be205-91c3-446a-8b89-274dafa75a42 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updated VIF entry in instance network info cache for port b3639567-a71c-4a6c-81b5-0a04aa8800b2. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG nova.network.neutron [req-5b97ff6d-490e-468e-b8e0-8fc411d5d425 req-fb2be205-91c3-446a-8b89-274dafa75a42 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updating instance_info_cache with network_info: [{"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5b97ff6d-490e-468e-b8e0-8fc411d5d425 req-fb2be205-91c3-446a-8b89-274dafa75a42 service nova] Releasing lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:33 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:00:33 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:00:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=6689MB free_disk=25.321735382080078GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:00:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 07d46763-1b59-4cce-9e10-e94d0efea05d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 45b6365f-333f-45f1-b619-3453cbe75a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 3a4f27f3-4573-43b5-827a-bbdae4ebce10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ee4a8248-9abc-45b3-9bf6-349c4d11f189 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 03a874db-ce51-4502-839d-7cf9ff2f9259 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance a5f4e2b3-6d84-418d-9109-07a4362b4d7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 541f3b1c-207c-4398-ad60-ea50e89d7327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:00:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:00:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:00:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:00:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 20:00:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:00:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:00:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:00:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:00:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:37 user nova-compute[72815]: INFO nova.compute.manager [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Shelving
Aug 17 20:00:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:37 user nova-compute[72815]: DEBUG nova.compute.manager [req-e12e9a56-2792-44b7-ad3b-79dc843678ea req-75c3aa26-e688-4360-834c-6cfd56beee5d service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-vif-unplugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e12e9a56-2792-44b7-ad3b-79dc843678ea req-75c3aa26-e688-4360-834c-6cfd56beee5d service nova] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e12e9a56-2792-44b7-ad3b-79dc843678ea req-75c3aa26-e688-4360-834c-6cfd56beee5d service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e12e9a56-2792-44b7-ad3b-79dc843678ea req-75c3aa26-e688-4360-834c-6cfd56beee5d service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:37 user nova-compute[72815]: DEBUG nova.compute.manager [req-e12e9a56-2792-44b7-ad3b-79dc843678ea req-75c3aa26-e688-4360-834c-6cfd56beee5d service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] No waiting events found dispatching network-vif-unplugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:00:37 user nova-compute[72815]: WARNING nova.compute.manager [req-e12e9a56-2792-44b7-ad3b-79dc843678ea req-75c3aa26-e688-4360-834c-6cfd56beee5d service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received unexpected event network-vif-unplugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 for instance with vm_state active and task_state shelving.
Aug 17 20:00:37 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Instance destroyed successfully.
Aug 17 20:00:37 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Beginning cold snapshot process
Aug 17 20:00:37 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 20:00:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk /opt/stack/data/nova/instances/snapshots/tmpjnybv089/c6095e823a49457699bf4ff0e7e555b2 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk /opt/stack/data/nova/instances/snapshots/tmpjnybv089/c6095e823a49457699bf4ff0e7e555b2" returned: 0 in 1.056s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:38 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Snapshot extracted, beginning image upload
Aug 17 20:00:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-f214feb0-cf78-4a96-9723-bf7386929f72 req-e61ad3de-754e-450d-a9f5-a16607da8d0b service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f214feb0-cf78-4a96-9723-bf7386929f72 req-e61ad3de-754e-450d-a9f5-a16607da8d0b service nova] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f214feb0-cf78-4a96-9723-bf7386929f72 req-e61ad3de-754e-450d-a9f5-a16607da8d0b service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f214feb0-cf78-4a96-9723-bf7386929f72 req-e61ad3de-754e-450d-a9f5-a16607da8d0b service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-f214feb0-cf78-4a96-9723-bf7386929f72 req-e61ad3de-754e-450d-a9f5-a16607da8d0b service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] No waiting events found dispatching network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:00:39 user nova-compute[72815]: WARNING nova.compute.manager [req-f214feb0-cf78-4a96-9723-bf7386929f72 req-e61ad3de-754e-450d-a9f5-a16607da8d0b service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received unexpected event network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG nova.objects.instance [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'flavor' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:40 user nova-compute[72815]: INFO nova.compute.manager [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Attaching volume 30b8cda4-cfa8-47e8-bed3-21de5c735094 to /dev/vdb
Aug 17 20:00:40 user nova-compute[72815]: DEBUG os_brick.utils [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e4cb52-9e45-4185-a9a0-1f16198d3b33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce958617-3236-4e4f-93dc-4dfec38054d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3bbb45-ac63-407f-aab1-3d7ef8f9d72e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a715f9e8-8221-4f9c-8e54-8906b18c86b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:00:40 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:00:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fabf44-b254-4815-b364-d22e37096880]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG os_brick.utils [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:00:40 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating existing volume attachment record: d7d68242-7835-4120-8bd6-412846eee4cf {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:00:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:41 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Snapshot image upload complete
Aug 17 20:00:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:00:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:41 user nova-compute[72815]: INFO nova.compute.manager [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Shelve offloading
Aug 17 20:00:41 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Instance destroyed successfully.
Aug 17 20:00:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:00:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:00:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquired lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:00:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:00:42 user nova-compute[72815]: DEBUG nova.network.neutron [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updating instance_info_cache with network_info: [{"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:00:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Releasing lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:00:43 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Instance destroyed successfully.
Aug 17 20:00:43 user nova-compute[72815]: DEBUG nova.objects.instance [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'resources' on Instance uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1768421689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1768421689',id=17,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwq6B6YucI61a+XA6DcquTL6Maoiz9alX/+69B1C2l5COMq45Rjhb7PiVHLcsSjjclf89Dqbs4NMf3C5D0xYFGI7dTuolACUVlLGI/QtrqyveSxLlTXfFpvHMAvbRCo5w==',key_name='tempest-keypair-1366413119',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='aa140294f17e4751b13e2d4a15b17ff9',ramdisk_id='',reservation_id='r-lho37lud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-632866040',owner_user_name='tempest-AttachVolumeShelveTestJSON-632866040-project-member',shelved_at='2023-08-17T20:00:41.686699',shelved_host='user',shelved_image_id='530f4758-6531-4612-a77e-61b351806cd9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82d9b206cf4499eaf518f7cd6a7a10c',uuid=ee4a8248-9abc-45b3-9bf6-349c4d11f189,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converting VIF {"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG os_vif [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3639567-a7, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-7fc86cab-356d-4459-b359-37fde590469c req-c143f1e4-831c-493d-a4ba-764751f47296 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-changed-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-7fc86cab-356d-4459-b359-37fde590469c req-c143f1e4-831c-493d-a4ba-764751f47296 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Refreshing instance network info cache due to event network-changed-b3639567-a71c-4a6c-81b5-0a04aa8800b2. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7fc86cab-356d-4459-b359-37fde590469c req-c143f1e4-831c-493d-a4ba-764751f47296 service nova] Acquiring lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7fc86cab-356d-4459-b359-37fde590469c req-c143f1e4-831c-493d-a4ba-764751f47296 service nova] Acquired lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG nova.network.neutron [req-7fc86cab-356d-4459-b359-37fde590469c req-c143f1e4-831c-493d-a4ba-764751f47296 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Refreshing network info cache for port b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:43 user nova-compute[72815]: INFO os_vif [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7')
Aug 17 20:00:43 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Deleting instance files /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189_del
Aug 17 20:00:43 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Deletion of /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189_del complete
Aug 17 20:00:43 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Deleted allocations for instance ee4a8248-9abc-45b3-9bf6-349c4d11f189
Aug 17 20:00:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:43 user nova-compute[72815]: DEBUG nova.objects.instance [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'numa_topology' on Instance uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:44 user nova-compute[72815]: DEBUG nova.network.neutron [req-7fc86cab-356d-4459-b359-37fde590469c req-c143f1e4-831c-493d-a4ba-764751f47296 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updated VIF entry in instance network info cache for port b3639567-a71c-4a6c-81b5-0a04aa8800b2. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:00:44 user nova-compute[72815]: DEBUG nova.network.neutron [req-7fc86cab-356d-4459-b359-37fde590469c req-c143f1e4-831c-493d-a4ba-764751f47296 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updating instance_info_cache with network_info: [{"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb3639567-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:00:44 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:00:44 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:00:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7fc86cab-356d-4459-b359-37fde590469c req-c143f1e4-831c-493d-a4ba-764751f47296 service nova] Releasing lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:00:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-19f9f21e-165f-4618-844f-0e773db641e0 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.407s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrhyWBRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:00:52 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:00:52 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:00:52 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a571d4-da80-4a01-aa69-37e42bafe7bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:00:52 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[90484d2e-7b56-453c-875f-997ce9793d07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094] added
Aug 17 20:00:52 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e3f776-3144-42cd-88fa-7820a68d851c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fb0ba2-4599-4358-a265-740a6622a9c1]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrhyWBRq {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrhyWBRq" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f435fd4f-4ca6-4812-a8f9-6e50bcd52b2d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SrhyWBRq'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddc9479-f1e7-41ce-ad5f-4da17a71e464]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8053bb03-ca84-425b-9b0b-5d6bff82a9f5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:00:52 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:00:52 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c274aae8-aefa-492d-8586-728deae77d4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260]
Aug 17 20:00:52 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260] successful.
Aug 17 20:00:52 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[588cb041-647e-4604-9d91-d24650797c64]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fca002-754d-4285-bad3-82825ff6407f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:00:52 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:00:52 user nova-compute[72815]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:00:52 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] HCTL ('39', '-', '-', 0) found on session 22 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c2bbe8-3584-4fc7-a360-beee206b9cd6]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Searching for a device in session 22 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrhyWBRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:00:52 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302437.6450205, ee4a8248-9abc-45b3-9bf6-349c4d11f189 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:00:52 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] VM Stopped (Lifecycle Event)
Aug 17 20:00:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5bef4a9a-99e3-4478-8c84-aff0b2136613 None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:00:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:00:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23036623166323937', 'path': '/dev/sdh'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:00:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036623166323937', 'path': '/dev/sdh'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:00:53 user nova-compute[72815]: DEBUG nova.objects.instance [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'flavor' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:00:53 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:00:53 user nova-compute[72815]:   <source dev="/dev/sdh"/>
Aug 17 20:00:53 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:00:53 user nova-compute[72815]:   <serial>30b8cda4-cfa8-47e8-bed3-21de5c735094</serial>
Aug 17 20:00:53 user nova-compute[72815]: </disk>
Aug 17 20:00:53 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:00:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:00:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:00:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] No VIF found with MAC fa:16:3e:7f:6e:78, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:00:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3b16aba3-5dc4-49c0-922f-85cf2ac330de tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.748s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG nova.compute.manager [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Stashing vm_state: active {{(pid=72815) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG nova.objects.instance [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'pci_requests' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:00:56 user nova-compute[72815]: INFO nova.compute.claims [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Claim successful on node user
Aug 17 20:00:56 user nova-compute[72815]: DEBUG nova.objects.instance [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'resources' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG nova.objects.instance [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:00:56 user nova-compute[72815]: INFO nova.compute.resource_tracker [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating resource usage from migration 7aa604a3-81e6-40fb-8398-85a8710bd4bd
Aug 17 20:00:56 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.595s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:56 user nova-compute[72815]: INFO nova.compute.manager [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Migrating
Aug 17 20:00:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:00:56 user nova-compute[72815]: INFO nova.compute.rpcapi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 17 20:00:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquired lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:00:56 user nova-compute[72815]: DEBUG nova.network.neutron [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:00:57 user nova-compute[72815]: DEBUG nova.network.neutron [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating instance_info_cache with network_info: [{"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:00:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Releasing lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:00:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Starting migrate_disk_and_power_off {{(pid=72815) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 20:00:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-31f0ac7d-335a-4ec7-aac6-984e3e97beb3 req-83c3729e-8d4e-4a24-8a1d-a7bfe233b76d service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-unplugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-31f0ac7d-335a-4ec7-aac6-984e3e97beb3 req-83c3729e-8d4e-4a24-8a1d-a7bfe233b76d service nova] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-31f0ac7d-335a-4ec7-aac6-984e3e97beb3 req-83c3729e-8d4e-4a24-8a1d-a7bfe233b76d service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-31f0ac7d-335a-4ec7-aac6-984e3e97beb3 req-83c3729e-8d4e-4a24-8a1d-a7bfe233b76d service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-31f0ac7d-335a-4ec7-aac6-984e3e97beb3 req-83c3729e-8d4e-4a24-8a1d-a7bfe233b76d service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] No waiting events found dispatching network-vif-unplugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:00:58 user nova-compute[72815]: WARNING nova.compute.manager [req-31f0ac7d-335a-4ec7-aac6-984e3e97beb3 req-83c3729e-8d4e-4a24-8a1d-a7bfe233b76d service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received unexpected event network-vif-unplugged-e936e6d3-48e1-4322-b2d4-779037eff32c for instance with vm_state active and task_state resize_migrating.
Aug 17 20:00:58 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Instance destroyed successfully.
Aug 17 20:00:58 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-468217050',display_name='tempest-ServerActionsTestOtherB-server-468217050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-468217050',id=14,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpS9twCAKB9Qcxa77kKBv1mcMWNNwvJ8PtuQNagNxi+2wHS7dCki+1ibMc73BH5JCIYY5sRP3ThGzFZPpzGom37joOakxOGFFMKzFdXVL+/I3uzE68ATLp8T4Wn8HgTCg==',key_name='tempest-keypair-1805104337',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:56:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f0bfaa4f27c4bf1bf6be9b74b9f8a09',ramdisk_id='',reservation_id='r-8y7ruqfi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-166537402',owner_user_name='tempest-ServerActionsTestOtherB-166537402-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03912162ae0f4b299c8c7b044b61798f',uuid=3a4f27f3-4573-43b5-827a-bbdae4ebce10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1239391925-network", "vif_mac": "fa:16:3e:7f:6e:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converting VIF {"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1239391925-network", "vif_mac": "fa:16:3e:7f:6e:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_vif [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape936e6d3-48, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:00:58 user nova-compute[72815]: INFO os_vif [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48')
Aug 17 20:00:58 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrhyWBRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:00:58 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dacbc59-8a73-469b-aeeb-b5091314d9eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5f0c00-4b01-48ec-b4ff-9fbb6eb4c54f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:00:58 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:00:58 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:00:58 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:00:58 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:00:58 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:00:58 user nova-compute[72815]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:00:58 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:00:58 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:00:58 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:00:58 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:00:58 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:00:58 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:00:58 user nova-compute[72815]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:00:58 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994475900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094'): ({'sdh'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Removing single pathed devices sdh {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d2cfe5-a6ba-4fe7-bf81-f04b4054856e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5442e3-9c4e-4a39-9c90-c93cf14a3252]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Flushing IO for device /dev/sdh {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffc2d79-c01f-4d8d-8991-6e75ae3918e3]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d439b4cb-541f-4efc-a8f7-d107ffc32a4a]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] SCSI volumes sdh have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83a4c06-65a0-4aaa-9a2a-2ddb00f689a8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33bc7ef-3e5c-4086-80e1-f0b5df6a385d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260]
Aug 17 20:00:58 user nova-compute[72815]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260] successful.
Aug 17 20:00:58 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5d5e1b-af40-4f99-819d-fa101509a338]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] <== disconnect_volume: return (333ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:00:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:00:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10_resize/disk /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CMD "cp -r /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10_resize/disk /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk" returned: 0 in 0.374s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:00:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10_resize/disk.info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk.info {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:00:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CMD "cp -r /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10_resize/disk.info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk.info" returned: 0 in 0.035s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:00 user nova-compute[72815]: INFO nova.compute.manager [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Terminating instance
Aug 17 20:01:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG nova.compute.manager [req-90cfeba8-2258-45bb-a12a-d12f8976e01f req-67688293-0289-46c0-8a59-cf3b5a31018d service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-90cfeba8-2258-45bb-a12a-d12f8976e01f req-67688293-0289-46c0-8a59-cf3b5a31018d service nova] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-90cfeba8-2258-45bb-a12a-d12f8976e01f req-67688293-0289-46c0-8a59-cf3b5a31018d service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-90cfeba8-2258-45bb-a12a-d12f8976e01f req-67688293-0289-46c0-8a59-cf3b5a31018d service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG nova.compute.manager [req-90cfeba8-2258-45bb-a12a-d12f8976e01f req-67688293-0289-46c0-8a59-cf3b5a31018d service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] No waiting events found dispatching network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:00 user nova-compute[72815]: WARNING nova.compute.manager [req-90cfeba8-2258-45bb-a12a-d12f8976e01f req-67688293-0289-46c0-8a59-cf3b5a31018d service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received unexpected event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c for instance with vm_state active and task_state resize_migrating.
Aug 17 20:01:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:00 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Instance destroyed successfully.
Aug 17 20:01:00 user nova-compute[72815]: DEBUG nova.objects.instance [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lazy-loading 'resources' on Instance uuid 07d46763-1b59-4cce-9e10-e94d0efea05d {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-17342816',display_name='tempest-ServerStableDeviceRescueTest-server-17342816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-17342816',id=4,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJrunJLrimEM+Gxd+hZ0sJyZLFWCB51uwbX7BQYwnQxoGyp8d2DETwVwLuci+7ubf+bNZxthaOWRg3z6FnbUfc/e9ggUpquvSY1IwPjdo3Nh8aVScHbxFmWLdJGFJkMXQ==',key_name='tempest-keypair-1184284913',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:57:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b85a305cdf974d10a935caff8ccec9b4',ramdisk_id='',reservation_id='r-bm8bw4wj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-344410182',owner_user_name='tempest-ServerStableDeviceRescueTest-344410182-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:59:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c83afcb788d541d1a3f8c75e5a39c6ce',uuid=07d46763-1b59-4cce-9e10-e94d0efea05d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Converting VIF {"id": "991f5622-2c12-4ea1-950b-19b55e89c57c", "address": "fa:16:3e:38:1e:21", "network": {"id": "557c4953-b996-4cb6-8b45-a1ca6ec545f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-779513091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b85a305cdf974d10a935caff8ccec9b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991f5622-2c", "ovs_interfaceid": "991f5622-2c12-4ea1-950b-19b55e89c57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:1e:21,bridge_name='br-int',has_traffic_filtering=True,id=991f5622-2c12-4ea1-950b-19b55e89c57c,network=Network(557c4953-b996-4cb6-8b45-a1ca6ec545f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991f5622-2c') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG os_vif [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:1e:21,bridge_name='br-int',has_traffic_filtering=True,id=991f5622-2c12-4ea1-950b-19b55e89c57c,network=Network(557c4953-b996-4cb6-8b45-a1ca6ec545f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991f5622-2c') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap991f5622-2c, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:01:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:01 user nova-compute[72815]: INFO os_vif [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:1e:21,bridge_name='br-int',has_traffic_filtering=True,id=991f5622-2c12-4ea1-950b-19b55e89c57c,network=Network(557c4953-b996-4cb6-8b45-a1ca6ec545f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991f5622-2c')
Aug 17 20:01:01 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Deleting instance files /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d_del
Aug 17 20:01:01 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Deletion of /opt/stack/data/nova/instances/07d46763-1b59-4cce-9e10-e94d0efea05d_del complete
Aug 17 20:01:01 user nova-compute[72815]: DEBUG nova.network.neutron [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Port e936e6d3-48e1-4322-b2d4-779037eff32c binding to destination host user is already ACTIVE {{(pid=72815) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 20:01:01 user nova-compute[72815]: INFO nova.compute.manager [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 20:01:01 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:01:01 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:01:01 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:01:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:01:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquired lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:01:01 user nova-compute[72815]: DEBUG nova.network.neutron [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:01:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:02 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Took 1.01 seconds to deallocate network for instance.
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating instance_info_cache with network_info: [{"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Releasing lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG os_brick.utils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-unplugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-unplugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:02 user nova-compute[72815]: WARNING nova.compute.manager [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-unplugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state deleted and task_state None.
Aug 17 20:01:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] Acquiring lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] No waiting events found dispatching network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:02 user nova-compute[72815]: WARNING nova.compute.manager [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received unexpected event network-vif-plugged-991f5622-2c12-4ea1-950b-19b55e89c57c for instance with vm_state deleted and task_state None.
Aug 17 20:01:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-bfdd2c59-f288-400e-9809-28b47effa5a3 req-74b92746-5178-4904-8a48-44c096fd73e0 service nova] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Received event network-vif-deleted-991f5622-2c12-4ea1-950b-19b55e89c57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a23286-b6bb-4caf-abf9-350df57ac20d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb4945a-2aa9-4656-83f5-71208f6af3f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[404b4371-04bb-46f3-97e5-49d23c7d7eb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd10ea7-af23-4188-9ab2-45bf841d7d9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:01:02 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4529dce-ce71-4d88-b1b1-df0ab379b185]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG os_brick.utils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.656s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:02 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Deleted allocations for instance 07d46763-1b59-4cce-9e10-e94d0efea05d
Aug 17 20:01:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-731c994f-ef80-4c64-b747-c64191cb4adc tempest-ServerStableDeviceRescueTest-344410182 tempest-ServerStableDeviceRescueTest-344410182-project-member] Lock "07d46763-1b59-4cce-9e10-e94d0efea05d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.814s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:13 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302458.563452, 3a4f27f3-4573-43b5-827a-bbdae4ebce10 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:01:13 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] VM Stopped (Lifecycle Event)
Aug 17 20:01:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d9fcdd09-82ac-48d8-9e92-703ba7f10eb2 None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d9fcdd09-82ac-48d8-9e92-703ba7f10eb2 None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:01:13 user nova-compute[72815]: INFO nova.compute.manager [None req-d9fcdd09-82ac-48d8-9e92-703ba7f10eb2 None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 20:01:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Starting finish_migration {{(pid=72815) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 20:01:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Instance directory exists: not creating {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 20:01:14 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Creating image(s)
Aug 17 20:01:14 user nova-compute[72815]: DEBUG nova.objects.instance [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk. size=21474836480 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk 21474836480 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: INFO nova.compute.manager [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Rescuing
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquired lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.network.neutron [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk 21474836480" returned: 0 in 0.053s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Ensure instance console log exists: /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Start _get_guest_xml network_info=[{"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1239391925-network", "vif_mac": "fa:16:3e:7f:6e:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': '237ba2a4-592c-4c87-981e-014fc4e468ff', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrhyWBRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3a4f27f3-4573-43b5-827a-bbdae4ebce10', 'attached_at': '2023-08-17T20:01:15.000000', 'detached_at': '', 'volume_id': '30b8cda4-cfa8-47e8-bed3-21de5c735094', 'serial': '30b8cda4-cfa8-47e8-bed3-21de5c735094'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:01:15 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:01:15 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.objects.instance [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrhyWBRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:01:15 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:01:15 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:01:15 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd98c28-5189-48e9-8a9b-c965ff5ecc55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:01:15 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1fb049-d185-4911-9534-faa6403d6f19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094] added
Aug 17 20:01:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8dfc14-46a0-4adf-9251-ecb237a0e4c4]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7109026-1517-4071-a0ed-70b64d3161c8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrhyWBRq {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrhyWBRq" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[431a360a-bea7-4445-9611-e4056a51a1de]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SrhyWBRq'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5166b49c-1d84-4a0b-867f-f314e8cd2200]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd81991-5a4a-461f-9ae6-3b1e471dc221]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2cdbaa-bd4d-4cf0-9135-f5ea712421c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260]
Aug 17 20:01:15 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260] successful.
Aug 17 20:01:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf8a540-e836-4ea4-9e9c-254d4b698bc4]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ec6adf-cd9f-4f9e-b605-458fc5da8b25]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:15 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] HCTL ('39', '-', '-', 0) found on session 23 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[68466890-2d1d-4648-b8d5-2474fa80acf7]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Searching for a device in session 23 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrhyWBRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302460.9634006, 07d46763-1b59-4cce-9e10-e94d0efea05d => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:01:15 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] VM Stopped (Lifecycle Event)
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.network.neutron [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Updating instance_info_cache with network_info: [{"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-08be4d64-0196-4785-8613-0cf729b8de8e None None] [instance: 07d46763-1b59-4cce-9e10-e94d0efea05d] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Releasing lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-7a0ca60f-c76b-46e4-a59b-4b3de91ba390 req-13d672a3-b04c-49b7-8dc8-8e1d1479323d service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received event network-vif-unplugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7a0ca60f-c76b-46e4-a59b-4b3de91ba390 req-13d672a3-b04c-49b7-8dc8-8e1d1479323d service nova] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7a0ca60f-c76b-46e4-a59b-4b3de91ba390 req-13d672a3-b04c-49b7-8dc8-8e1d1479323d service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7a0ca60f-c76b-46e4-a59b-4b3de91ba390 req-13d672a3-b04c-49b7-8dc8-8e1d1479323d service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-7a0ca60f-c76b-46e4-a59b-4b3de91ba390 req-13d672a3-b04c-49b7-8dc8-8e1d1479323d service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] No waiting events found dispatching network-vif-unplugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:16 user nova-compute[72815]: WARNING nova.compute.manager [req-7a0ca60f-c76b-46e4-a59b-4b3de91ba390 req-13d672a3-b04c-49b7-8dc8-8e1d1479323d service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received unexpected event network-vif-unplugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 for instance with vm_state active and task_state rescuing.
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:16 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Instance destroyed successfully.
Aug 17 20:01:16 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Attempting rescue
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72815) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Instance directory exists: not creating {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 20:01:16 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Creating image(s)
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "/opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "/opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.objects.instance [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'trusted_certs' on Instance uuid ec0afde2-8d2b-451a-a226-be933e28ad6f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23036623166323937', 'path': '/dev/sdh'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036623166323937', 'path': '/dev/sdh'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue" returned: 0 in 0.057s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.objects.instance [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'migration_context' on Instance uuid ec0afde2-8d2b-451a-a226-be933e28ad6f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Start _get_guest_xml network_info=[{"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "vif_mac": "fa:16:3e:2f:69:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.objects.instance [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'resources' on Instance uuid ec0afde2-8d2b-451a-a226-be933e28ad6f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-468217050',display_name='tempest-ServerActionsTestOtherB-server-468217050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-468217050',id=14,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpS9twCAKB9Qcxa77kKBv1mcMWNNwvJ8PtuQNagNxi+2wHS7dCki+1ibMc73BH5JCIYY5sRP3ThGzFZPpzGom37joOakxOGFFMKzFdXVL+/I3uzE68ATLp8T4Wn8HgTCg==',key_name='tempest-keypair-1805104337',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:56:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f0bfaa4f27c4bf1bf6be9b74b9f8a09',ramdisk_id='',reservation_id='r-8y7ruqfi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-166537402',owner_user_name='tempest-ServerActionsTestOtherB-166537402-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03912162ae0f4b299c8c7b044b61798f',uuid=3a4f27f3-4573-43b5-827a-bbdae4ebce10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1239391925-network", "vif_mac": "fa:16:3e:7f:6e:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converting VIF {"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1239391925-network", "vif_mac": "fa:16:3e:7f:6e:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:01:16 user nova-compute[72815]:   <uuid>3a4f27f3-4573-43b5-827a-bbdae4ebce10</uuid>
Aug 17 20:01:16 user nova-compute[72815]:   <name>instance-0000000e</name>
Aug 17 20:01:16 user nova-compute[72815]:   <memory>2097152</memory>
Aug 17 20:01:16 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:01:16 user nova-compute[72815]:   <metadata>
Aug 17 20:01:16 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:01:16 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:01:16 user nova-compute[72815]:       <nova:name>tempest-ServerActionsTestOtherB-server-468217050</nova:name>
Aug 17 20:01:16 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:01:15</nova:creationTime>
Aug 17 20:01:16 user nova-compute[72815]:       <nova:flavor name="m1.small">
Aug 17 20:01:16 user nova-compute[72815]:         <nova:memory>2048</nova:memory>
Aug 17 20:01:16 user nova-compute[72815]:         <nova:disk>20</nova:disk>
Aug 17 20:01:16 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:01:16 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:01:16 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:01:16 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:01:16 user nova-compute[72815]:       <nova:owner>
Aug 17 20:01:16 user nova-compute[72815]:         <nova:user uuid="03912162ae0f4b299c8c7b044b61798f">tempest-ServerActionsTestOtherB-166537402-project-member</nova:user>
Aug 17 20:01:16 user nova-compute[72815]:         <nova:project uuid="6f0bfaa4f27c4bf1bf6be9b74b9f8a09">tempest-ServerActionsTestOtherB-166537402</nova:project>
Aug 17 20:01:16 user nova-compute[72815]:       </nova:owner>
Aug 17 20:01:16 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:01:16 user nova-compute[72815]:       <nova:ports>
Aug 17 20:01:16 user nova-compute[72815]:         <nova:port uuid="e936e6d3-48e1-4322-b2d4-779037eff32c">
Aug 17 20:01:16 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 20:01:16 user nova-compute[72815]:         </nova:port>
Aug 17 20:01:16 user nova-compute[72815]:       </nova:ports>
Aug 17 20:01:16 user nova-compute[72815]:     </nova:instance>
Aug 17 20:01:16 user nova-compute[72815]:   </metadata>
Aug 17 20:01:16 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:01:16 user nova-compute[72815]:     <system>
Aug 17 20:01:16 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:01:16 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:01:16 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:01:16 user nova-compute[72815]:       <entry name="serial">3a4f27f3-4573-43b5-827a-bbdae4ebce10</entry>
Aug 17 20:01:16 user nova-compute[72815]:       <entry name="uuid">3a4f27f3-4573-43b5-827a-bbdae4ebce10</entry>
Aug 17 20:01:16 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:01:16 user nova-compute[72815]:     </system>
Aug 17 20:01:16 user nova-compute[72815]:   </sysinfo>
Aug 17 20:01:16 user nova-compute[72815]:   <os>
Aug 17 20:01:16 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:01:16 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:01:16 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:01:16 user nova-compute[72815]:   </os>
Aug 17 20:01:16 user nova-compute[72815]:   <features>
Aug 17 20:01:16 user nova-compute[72815]:     <acpi/>
Aug 17 20:01:16 user nova-compute[72815]:     <apic/>
Aug 17 20:01:16 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:01:16 user nova-compute[72815]:   </features>
Aug 17 20:01:16 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:01:16 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:01:16 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:01:16 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:01:16 user nova-compute[72815]:   </clock>
Aug 17 20:01:16 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:01:16 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:01:16 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:01:16 user nova-compute[72815]:   </cpu>
Aug 17 20:01:16 user nova-compute[72815]:   <devices>
Aug 17 20:01:16 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:01:16 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:01:16 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk"/>
Aug 17 20:01:16 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:01:16 user nova-compute[72815]:     </disk>
Aug 17 20:01:16 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:01:16 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:01:16 user nova-compute[72815]:       <source dev="/dev/sdh"/>
Aug 17 20:01:16 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 20:01:16 user nova-compute[72815]:       <serial>30b8cda4-cfa8-47e8-bed3-21de5c735094</serial>
Aug 17 20:01:16 user nova-compute[72815]:     </disk>
Aug 17 20:01:16 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:01:16 user nova-compute[72815]:       <mac address="fa:16:3e:7f:6e:78"/>
Aug 17 20:01:16 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:01:16 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:01:16 user nova-compute[72815]:       <target dev="tape936e6d3-48"/>
Aug 17 20:01:16 user nova-compute[72815]:     </interface>
Aug 17 20:01:16 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:01:16 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/console.log" append="off"/>
Aug 17 20:01:16 user nova-compute[72815]:     </serial>
Aug 17 20:01:16 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:01:16 user nova-compute[72815]:     <video>
Aug 17 20:01:16 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:01:16 user nova-compute[72815]:     </video>
Aug 17 20:01:16 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:01:16 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:01:16 user nova-compute[72815]:     </rng>
Aug 17 20:01:16 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:01:16 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:01:16 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:01:16 user nova-compute[72815]:     </memballoon>
Aug 17 20:01:16 user nova-compute[72815]:   </devices>
Aug 17 20:01:16 user nova-compute[72815]: </domain>
Aug 17 20:01:16 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-468217050',display_name='tempest-ServerActionsTestOtherB-server-468217050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-468217050',id=14,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpS9twCAKB9Qcxa77kKBv1mcMWNNwvJ8PtuQNagNxi+2wHS7dCki+1ibMc73BH5JCIYY5sRP3ThGzFZPpzGom37joOakxOGFFMKzFdXVL+/I3uzE68ATLp8T4Wn8HgTCg==',key_name='tempest-keypair-1805104337',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:56:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f0bfaa4f27c4bf1bf6be9b74b9f8a09',ramdisk_id='',reservation_id='r-8y7ruqfi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-166537402',owner_user_name='tempest-ServerActionsTestOtherB-166537402-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03912162ae0f4b299c8c7b044b61798f',uuid=3a4f27f3-4573-43b5-827a-bbdae4ebce10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1239391925-network", "vif_mac": "fa:16:3e:7f:6e:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converting VIF {"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1239391925-network", "vif_mac": "fa:16:3e:7f:6e:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG os_vif [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.objects.instance [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'numa_topology' on Instance uuid ec0afde2-8d2b-451a-a226-be933e28ad6f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape936e6d3-48, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape936e6d3-48, col_values=(('external_ids', {'iface-id': 'e936e6d3-48e1-4322-b2d4-779037eff32c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:6e:78', 'vm-uuid': '3a4f27f3-4573-43b5-827a-bbdae4ebce10'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:01:16 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:01:16 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:01:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.objects.instance [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'vcpu_model' on Instance uuid ec0afde2-8d2b-451a-a226-be933e28ad6f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:17 user nova-compute[72815]: INFO os_vif [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48')
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1153727331',display_name='tempest-ServerRescueNegativeTestJSON-server-1153727331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1153727331',id=20,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:59:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6d2cf2910f4d3d9924480d68057b5a',ramdisk_id='',reservation_id='r-z9z0cph6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-335799606',owner_user_name='tempest-ServerRescueNegativeTestJSON-335799606-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:38Z,user_data=None,user_id='fa27c69e40f243d9b38c87250b5dba5f',uuid=ec0afde2-8d2b-451a-a226-be933e28ad6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "vif_mac": "fa:16:3e:2f:69:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converting VIF {"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "vif_mac": "fa:16:3e:2f:69:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:69:15,bridge_name='br-int',has_traffic_filtering=True,id=5c1dfe2e-5dea-442a-b69a-8ac17c027541,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1dfe2e-5d') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.objects.instance [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'pci_devices' on Instance uuid ec0afde2-8d2b-451a-a226-be933e28ad6f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:01:17 user nova-compute[72815]:   <uuid>ec0afde2-8d2b-451a-a226-be933e28ad6f</uuid>
Aug 17 20:01:17 user nova-compute[72815]:   <name>instance-00000014</name>
Aug 17 20:01:17 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:01:17 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:01:17 user nova-compute[72815]:   <metadata>
Aug 17 20:01:17 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:01:17 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:01:17 user nova-compute[72815]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1153727331</nova:name>
Aug 17 20:01:17 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:01:16</nova:creationTime>
Aug 17 20:01:17 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:01:17 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:01:17 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:01:17 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:01:17 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:01:17 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:01:17 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:01:17 user nova-compute[72815]:       <nova:owner>
Aug 17 20:01:17 user nova-compute[72815]:         <nova:user uuid="fa27c69e40f243d9b38c87250b5dba5f">tempest-ServerRescueNegativeTestJSON-335799606-project-member</nova:user>
Aug 17 20:01:17 user nova-compute[72815]:         <nova:project uuid="4e6d2cf2910f4d3d9924480d68057b5a">tempest-ServerRescueNegativeTestJSON-335799606</nova:project>
Aug 17 20:01:17 user nova-compute[72815]:       </nova:owner>
Aug 17 20:01:17 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:01:17 user nova-compute[72815]:       <nova:ports>
Aug 17 20:01:17 user nova-compute[72815]:         <nova:port uuid="5c1dfe2e-5dea-442a-b69a-8ac17c027541">
Aug 17 20:01:17 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 20:01:17 user nova-compute[72815]:         </nova:port>
Aug 17 20:01:17 user nova-compute[72815]:       </nova:ports>
Aug 17 20:01:17 user nova-compute[72815]:     </nova:instance>
Aug 17 20:01:17 user nova-compute[72815]:   </metadata>
Aug 17 20:01:17 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:01:17 user nova-compute[72815]:     <system>
Aug 17 20:01:17 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:01:17 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:01:17 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:01:17 user nova-compute[72815]:       <entry name="serial">ec0afde2-8d2b-451a-a226-be933e28ad6f</entry>
Aug 17 20:01:17 user nova-compute[72815]:       <entry name="uuid">ec0afde2-8d2b-451a-a226-be933e28ad6f</entry>
Aug 17 20:01:17 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:01:17 user nova-compute[72815]:     </system>
Aug 17 20:01:17 user nova-compute[72815]:   </sysinfo>
Aug 17 20:01:17 user nova-compute[72815]:   <os>
Aug 17 20:01:17 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:01:17 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:01:17 user nova-compute[72815]:   </os>
Aug 17 20:01:17 user nova-compute[72815]:   <features>
Aug 17 20:01:17 user nova-compute[72815]:     <acpi/>
Aug 17 20:01:17 user nova-compute[72815]:     <apic/>
Aug 17 20:01:17 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:01:17 user nova-compute[72815]:   </features>
Aug 17 20:01:17 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:01:17 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:01:17 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:01:17 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:01:17 user nova-compute[72815]:   </clock>
Aug 17 20:01:17 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:01:17 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:01:17 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:01:17 user nova-compute[72815]:   </cpu>
Aug 17 20:01:17 user nova-compute[72815]:   <devices>
Aug 17 20:01:17 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:01:17 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:01:17 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue"/>
Aug 17 20:01:17 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:01:17 user nova-compute[72815]:     </disk>
Aug 17 20:01:17 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:01:17 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:01:17 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk"/>
Aug 17 20:01:17 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 20:01:17 user nova-compute[72815]:     </disk>
Aug 17 20:01:17 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:01:17 user nova-compute[72815]:       <mac address="fa:16:3e:2f:69:15"/>
Aug 17 20:01:17 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:01:17 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:01:17 user nova-compute[72815]:       <target dev="tap5c1dfe2e-5d"/>
Aug 17 20:01:17 user nova-compute[72815]:     </interface>
Aug 17 20:01:17 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:01:17 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/console.log" append="off"/>
Aug 17 20:01:17 user nova-compute[72815]:     </serial>
Aug 17 20:01:17 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:01:17 user nova-compute[72815]:     <video>
Aug 17 20:01:17 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:01:17 user nova-compute[72815]:     </video>
Aug 17 20:01:17 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:01:17 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:01:17 user nova-compute[72815]:     </rng>
Aug 17 20:01:17 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:01:17 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:01:17 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:01:17 user nova-compute[72815]:     </memballoon>
Aug 17 20:01:17 user nova-compute[72815]:   </devices>
Aug 17 20:01:17 user nova-compute[72815]: </domain>
Aug 17 20:01:17 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:01:17 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Instance destroyed successfully.
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] No VIF found with MAC fa:16:3e:7f:6e:78, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:01:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No VIF found with MAC fa:16:3e:2f:69:15, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:01:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-e7f27e92-8209-417c-9829-6250f072a807 req-0f253bf3-dbaf-4227-bcbc-b4de132889d7 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received event network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e7f27e92-8209-417c-9829-6250f072a807 req-0f253bf3-dbaf-4227-bcbc-b4de132889d7 service nova] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e7f27e92-8209-417c-9829-6250f072a807 req-0f253bf3-dbaf-4227-bcbc-b4de132889d7 service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e7f27e92-8209-417c-9829-6250f072a807 req-0f253bf3-dbaf-4227-bcbc-b4de132889d7 service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-e7f27e92-8209-417c-9829-6250f072a807 req-0f253bf3-dbaf-4227-bcbc-b4de132889d7 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] No waiting events found dispatching network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:18 user nova-compute[72815]: WARNING nova.compute.manager [req-e7f27e92-8209-417c-9829-6250f072a807 req-0f253bf3-dbaf-4227-bcbc-b4de132889d7 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received unexpected event network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 for instance with vm_state active and task_state rescuing.
Aug 17 20:01:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-6692dcbb-10b6-4bfb-b4c1-1c80c7160566 req-ef94ec91-06c7-42c9-a294-3c9c2c05b962 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6692dcbb-10b6-4bfb-b4c1-1c80c7160566 req-ef94ec91-06c7-42c9-a294-3c9c2c05b962 service nova] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6692dcbb-10b6-4bfb-b4c1-1c80c7160566 req-ef94ec91-06c7-42c9-a294-3c9c2c05b962 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6692dcbb-10b6-4bfb-b4c1-1c80c7160566 req-ef94ec91-06c7-42c9-a294-3c9c2c05b962 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-6692dcbb-10b6-4bfb-b4c1-1c80c7160566 req-ef94ec91-06c7-42c9-a294-3c9c2c05b962 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] No waiting events found dispatching network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:20 user nova-compute[72815]: WARNING nova.compute.manager [req-6692dcbb-10b6-4bfb-b4c1-1c80c7160566 req-ef94ec91-06c7-42c9-a294-3c9c2c05b962 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received unexpected event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c for instance with vm_state active and task_state resize_finish.
Aug 17 20:01:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-986fc4b0-9847-4b45-a32d-71019a3f6519 req-a4010484-bb09-4826-96c7-f66bddb1f930 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-986fc4b0-9847-4b45-a32d-71019a3f6519 req-a4010484-bb09-4826-96c7-f66bddb1f930 service nova] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-986fc4b0-9847-4b45-a32d-71019a3f6519 req-a4010484-bb09-4826-96c7-f66bddb1f930 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-986fc4b0-9847-4b45-a32d-71019a3f6519 req-a4010484-bb09-4826-96c7-f66bddb1f930 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-986fc4b0-9847-4b45-a32d-71019a3f6519 req-a4010484-bb09-4826-96c7-f66bddb1f930 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] No waiting events found dispatching network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:22 user nova-compute[72815]: WARNING nova.compute.manager [req-986fc4b0-9847-4b45-a32d-71019a3f6519 req-a4010484-bb09-4826-96c7-f66bddb1f930 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received unexpected event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c for instance with vm_state active and task_state resize_finish.
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-6feb5206-7d56-4930-887a-3a0418d6b354 req-8ea0c32d-ddfb-46c6-b174-0390ef85637b service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Received event network-changed-419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-6feb5206-7d56-4930-887a-3a0418d6b354 req-8ea0c32d-ddfb-46c6-b174-0390ef85637b service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Refreshing instance network info cache due to event network-changed-419cc7ce-bdbb-4add-81ff-e40402e5997d. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6feb5206-7d56-4930-887a-3a0418d6b354 req-8ea0c32d-ddfb-46c6-b174-0390ef85637b service nova] Acquiring lock "refresh_cache-a5f4e2b3-6d84-418d-9109-07a4362b4d7b" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6feb5206-7d56-4930-887a-3a0418d6b354 req-8ea0c32d-ddfb-46c6-b174-0390ef85637b service nova] Acquired lock "refresh_cache-a5f4e2b3-6d84-418d-9109-07a4362b4d7b" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.network.neutron [req-6feb5206-7d56-4930-887a-3a0418d6b354 req-8ea0c32d-ddfb-46c6-b174-0390ef85637b service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Refreshing network info cache for port 419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-be88b645-3bfe-4e86-b650-9aa6b39582cc tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for ec0afde2-8d2b-451a-a226-be933e28ad6f due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302482.7248204, ec0afde2-8d2b-451a-a226-be933e28ad6f => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:01:22 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] VM Resumed (Lifecycle Event)
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:22 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Instance running successfully.
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Failed to set time: agent not configured {{(pid=72815) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-dc77da8c-9212-403a-bada-1c661534f01f tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] finish_migration finished successfully. {{(pid=72815) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 20:01:22 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302482.7289464, ec0afde2-8d2b-451a-a226-be933e28ad6f => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:01:22 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] VM Started (Lifecycle Event)
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302482.7384458, 3a4f27f3-4573-43b5-827a-bbdae4ebce10 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:01:22 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] VM Resumed (Lifecycle Event)
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:01:23 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 20:01:23 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302482.738603, 3a4f27f3-4573-43b5-827a-bbdae4ebce10 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:01:23 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] VM Started (Lifecycle Event)
Aug 17 20:01:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:01:23 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lazy-loading 'flavor' on Instance uuid a5f4e2b3-6d84-418d-9109-07a4362b4d7b {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG nova.network.neutron [req-6feb5206-7d56-4930-887a-3a0418d6b354 req-8ea0c32d-ddfb-46c6-b174-0390ef85637b service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Updated VIF entry in instance network info cache for port 419cc7ce-bdbb-4add-81ff-e40402e5997d. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG nova.network.neutron [req-6feb5206-7d56-4930-887a-3a0418d6b354 req-8ea0c32d-ddfb-46c6-b174-0390ef85637b service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Updating instance_info_cache with network_info: [{"id": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "address": "fa:16:3e:ed:51:37", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419cc7ce-bd", "ovs_interfaceid": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6feb5206-7d56-4930-887a-3a0418d6b354 req-8ea0c32d-ddfb-46c6-b174-0390ef85637b service nova] Releasing lock "refresh_cache-a5f4e2b3-6d84-418d-9109-07a4362b4d7b" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:23 user nova-compute[72815]: INFO nova.compute.manager [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Attaching volume c5548c96-7a41-4285-942d-a284fd6e93be to /dev/vdb
Aug 17 20:01:23 user nova-compute[72815]: DEBUG os_brick.utils [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ba83d1-77b2-40fb-92b3-69f2fe0e0739]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3096e4e3-44f9-4ed8-8e15-7ea742a96040]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[458af84e-8535-4a69-8117-068e86b5eb05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff3bc65-4a82-4a02-af83-b75c50042fec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:01:23 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceae602-43bd-4d8c-9225-e56b9c482537]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG os_brick.utils [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Updating existing volume attachment record: 222739ce-767a-4163-82f4-302466c5e5a6 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG nova.compute.manager [req-12f09c15-adc0-459b-afad-aabfc41f0a28 req-5a505625-9983-49e4-8b95-92221a1fb5cf service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received event network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-12f09c15-adc0-459b-afad-aabfc41f0a28 req-5a505625-9983-49e4-8b95-92221a1fb5cf service nova] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-12f09c15-adc0-459b-afad-aabfc41f0a28 req-5a505625-9983-49e4-8b95-92221a1fb5cf service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-12f09c15-adc0-459b-afad-aabfc41f0a28 req-5a505625-9983-49e4-8b95-92221a1fb5cf service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:23 user nova-compute[72815]: DEBUG nova.compute.manager [req-12f09c15-adc0-459b-afad-aabfc41f0a28 req-5a505625-9983-49e4-8b95-92221a1fb5cf service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] No waiting events found dispatching network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:23 user nova-compute[72815]: WARNING nova.compute.manager [req-12f09c15-adc0-459b-afad-aabfc41f0a28 req-5a505625-9983-49e4-8b95-92221a1fb5cf service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received unexpected event network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 for instance with vm_state rescued and task_state None.
Aug 17 20:01:24 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:01:25 user nova-compute[72815]: DEBUG nova.compute.manager [req-14ebdc50-7def-44ce-91d7-6009cfdaaf23 req-9f8b8b3d-afc3-4031-9b18-78d8616c7f82 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received event network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-14ebdc50-7def-44ce-91d7-6009cfdaaf23 req-9f8b8b3d-afc3-4031-9b18-78d8616c7f82 service nova] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-14ebdc50-7def-44ce-91d7-6009cfdaaf23 req-9f8b8b3d-afc3-4031-9b18-78d8616c7f82 service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-14ebdc50-7def-44ce-91d7-6009cfdaaf23 req-9f8b8b3d-afc3-4031-9b18-78d8616c7f82 service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:25 user nova-compute[72815]: DEBUG nova.compute.manager [req-14ebdc50-7def-44ce-91d7-6009cfdaaf23 req-9f8b8b3d-afc3-4031-9b18-78d8616c7f82 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] No waiting events found dispatching network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:25 user nova-compute[72815]: WARNING nova.compute.manager [req-14ebdc50-7def-44ce-91d7-6009cfdaaf23 req-9f8b8b3d-afc3-4031-9b18-78d8616c7f82 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received unexpected event network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 for instance with vm_state rescued and task_state None.
Aug 17 20:01:25 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:01:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:27 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:01:27 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:01:28 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:01:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:28 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:01:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:34 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:01:34 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7116MB free_disk=25.367366790771484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Applying migration context for instance 3a4f27f3-4573-43b5-827a-bbdae4ebce10 as it has an incoming, in-progress migration 7aa604a3-81e6-40fb-8398-85a8710bd4bd. Migration status is finished {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 20:01:34 user nova-compute[72815]: INFO nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating resource usage from migration 7aa604a3-81e6-40fb-8398-85a8710bd4bd
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 45b6365f-333f-45f1-b619-3453cbe75a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 03a874db-ce51-4502-839d-7cf9ff2f9259 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance a5f4e2b3-6d84-418d-9109-07a4362b4d7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 541f3b1c-207c-4398-ad60-ea50e89d7327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Migration 7aa604a3-81e6-40fb-8398-85a8710bd4bd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 3a4f27f3-4573-43b5-827a-bbdae4ebce10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:01:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.732s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquired lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG nova.network.neutron [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'info_cache' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:01:35 user nova-compute[72815]: DEBUG nova.objects.instance [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lazy-loading 'info_cache' on Instance uuid 1a714bfa-0b06-4ef8-865a-819abbc64be5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.network.neutron [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Updating instance_info_cache with network_info: [{"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Releasing lock "refresh_cache-1800ab7b-dd88-45fb-9370-1b77b8cbf893" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:01:36 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance destroyed successfully.
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'resources' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643279889',display_name='tempest-AttachVolumeTestJSON-server-643279889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643279889',id=5,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESF266QwfIKeTik8wnoygIiOf2r6BrCWxIIzDojrbBZKm/zXPBtL9YHLKhpKFS8eHXyHAtcWfIKVJD6LLHKDkJll+G0nOWdMGtF8im19Z7tm6u5x2HPboD1YjRBA8g36A==',key_name='tempest-keypair-447370262',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:53:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fb016b8ab299475e9f916809c7b55182',ramdisk_id='',reservation_id='r-0ehl5jun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1462912324',owner_user_name='tempest-AttachVolumeTestJSON-1462912324-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c894534b34d943229dc89f6d58836acb',uuid=1800ab7b-dd88-45fb-9370-1b77b8cbf893,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converting VIF {"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG os_vif [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d010d95-17, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:01:36 user nova-compute[72815]: INFO os_vif [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17')
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Start _get_guest_xml network_info=[{"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'numa_topology' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:36 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:01:36 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643279889',display_name='tempest-AttachVolumeTestJSON-server-643279889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643279889',id=5,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESF266QwfIKeTik8wnoygIiOf2r6BrCWxIIzDojrbBZKm/zXPBtL9YHLKhpKFS8eHXyHAtcWfIKVJD6LLHKDkJll+G0nOWdMGtF8im19Z7tm6u5x2HPboD1YjRBA8g36A==',key_name='tempest-keypair-447370262',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:53:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fb016b8ab299475e9f916809c7b55182',ramdisk_id='',reservation_id='r-0ehl5jun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1462912324',owner_user_name='tempest-AttachVolumeTestJSON-1462912324-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c894534b34d943229dc89f6d58836acb',uuid=1800ab7b-dd88-45fb-9370-1b77b8cbf893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converting VIF {"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'pci_devices' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:01:36 user nova-compute[72815]:   <uuid>1800ab7b-dd88-45fb-9370-1b77b8cbf893</uuid>
Aug 17 20:01:36 user nova-compute[72815]:   <name>instance-00000005</name>
Aug 17 20:01:36 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:01:36 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:01:36 user nova-compute[72815]:   <metadata>
Aug 17 20:01:36 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:01:36 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:01:36 user nova-compute[72815]:       <nova:name>tempest-AttachVolumeTestJSON-server-643279889</nova:name>
Aug 17 20:01:36 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:01:36</nova:creationTime>
Aug 17 20:01:36 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:01:36 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:01:36 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:01:36 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:01:36 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:01:36 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:01:36 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:01:36 user nova-compute[72815]:       <nova:owner>
Aug 17 20:01:36 user nova-compute[72815]:         <nova:user uuid="c894534b34d943229dc89f6d58836acb">tempest-AttachVolumeTestJSON-1462912324-project-member</nova:user>
Aug 17 20:01:36 user nova-compute[72815]:         <nova:project uuid="fb016b8ab299475e9f916809c7b55182">tempest-AttachVolumeTestJSON-1462912324</nova:project>
Aug 17 20:01:36 user nova-compute[72815]:       </nova:owner>
Aug 17 20:01:36 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:01:36 user nova-compute[72815]:       <nova:ports>
Aug 17 20:01:36 user nova-compute[72815]:         <nova:port uuid="7d010d95-173c-44df-be70-170e3ca59b0e">
Aug 17 20:01:36 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 20:01:36 user nova-compute[72815]:         </nova:port>
Aug 17 20:01:36 user nova-compute[72815]:       </nova:ports>
Aug 17 20:01:36 user nova-compute[72815]:     </nova:instance>
Aug 17 20:01:36 user nova-compute[72815]:   </metadata>
Aug 17 20:01:36 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:01:36 user nova-compute[72815]:     <system>
Aug 17 20:01:36 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:01:36 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:01:36 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:01:36 user nova-compute[72815]:       <entry name="serial">1800ab7b-dd88-45fb-9370-1b77b8cbf893</entry>
Aug 17 20:01:36 user nova-compute[72815]:       <entry name="uuid">1800ab7b-dd88-45fb-9370-1b77b8cbf893</entry>
Aug 17 20:01:36 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:01:36 user nova-compute[72815]:     </system>
Aug 17 20:01:36 user nova-compute[72815]:   </sysinfo>
Aug 17 20:01:36 user nova-compute[72815]:   <os>
Aug 17 20:01:36 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:01:36 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:01:36 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:01:36 user nova-compute[72815]:   </os>
Aug 17 20:01:36 user nova-compute[72815]:   <features>
Aug 17 20:01:36 user nova-compute[72815]:     <acpi/>
Aug 17 20:01:36 user nova-compute[72815]:     <apic/>
Aug 17 20:01:36 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:01:36 user nova-compute[72815]:   </features>
Aug 17 20:01:36 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:01:36 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:01:36 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:01:36 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:01:36 user nova-compute[72815]:   </clock>
Aug 17 20:01:36 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:01:36 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:01:36 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:01:36 user nova-compute[72815]:   </cpu>
Aug 17 20:01:36 user nova-compute[72815]:   <devices>
Aug 17 20:01:36 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:01:36 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:01:36 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk"/>
Aug 17 20:01:36 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:01:36 user nova-compute[72815]:     </disk>
Aug 17 20:01:36 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:01:36 user nova-compute[72815]:       <mac address="fa:16:3e:ef:cb:33"/>
Aug 17 20:01:36 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:01:36 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:01:36 user nova-compute[72815]:       <target dev="tap7d010d95-17"/>
Aug 17 20:01:36 user nova-compute[72815]:     </interface>
Aug 17 20:01:36 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:01:36 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/console.log" append="off"/>
Aug 17 20:01:36 user nova-compute[72815]:     </serial>
Aug 17 20:01:36 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:01:36 user nova-compute[72815]:     <video>
Aug 17 20:01:36 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:01:36 user nova-compute[72815]:     </video>
Aug 17 20:01:36 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:01:36 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:01:36 user nova-compute[72815]:     </rng>
Aug 17 20:01:36 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:01:36 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:01:36 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:01:36 user nova-compute[72815]:     </memballoon>
Aug 17 20:01:36 user nova-compute[72815]:   </devices>
Aug 17 20:01:36 user nova-compute[72815]: </domain>
Aug 17 20:01:36 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Updating instance_info_cache with network_info: [{"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.208s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Cannot resize image /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'migration_context' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643279889',display_name='tempest-AttachVolumeTestJSON-server-643279889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643279889',id=5,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESF266QwfIKeTik8wnoygIiOf2r6BrCWxIIzDojrbBZKm/zXPBtL9YHLKhpKFS8eHXyHAtcWfIKVJD6LLHKDkJll+G0nOWdMGtF8im19Z7tm6u5x2HPboD1YjRBA8g36A==',key_name='tempest-keypair-447370262',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:53:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='fb016b8ab299475e9f916809c7b55182',ramdisk_id='',reservation_id='r-0ehl5jun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1462912324',owner_user_name='tempest-AttachVolumeTestJSON-1462912324-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c894534b34d943229dc89f6d58836acb',uuid=1800ab7b-dd88-45fb-9370-1b77b8cbf893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converting VIF {"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG os_vif [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d010d95-17, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d010d95-17, col_values=(('external_ids', {'iface-id': '7d010d95-173c-44df-be70-170e3ca59b0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:cb:33', 'vm-uuid': '1800ab7b-dd88-45fb-9370-1b77b8cbf893'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:37 user nova-compute[72815]: INFO os_vif [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17')
Aug 17 20:01:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVUREweg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:01:37 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:01:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:01:37 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:01:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:01:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:01:37 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:01:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a42958-8e83-4c7f-bbd7-84e04eca773d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:01:38 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce92aaea-c786-46e1-b0bd-fab2cdaa8abe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be] added
Aug 17 20:01:38 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3448702b-bdef-4e7c-a67a-1555f0cd7231]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e22bcd-1d07-4e6d-a76a-28fce7f633ba]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVUREweg {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVUREweg" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f11603-26f9-4443-9f85-a8ea83d6c861]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yVUREweg'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde71e90-dcf3-4d3c-84a1-bd1fa8d592d5]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb825bf1-af1b-4785-a61d-67e428032e03]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:38 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:38 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f675a73b-119a-453c-af1c-3cc762815194]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be, portal: 172.16.0.220,3260]
Aug 17 20:01:38 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be, portal: 172.16.0.220,3260] successful.
Aug 17 20:01:38 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78a10c0-291c-4781-ac1c-da76e5f9c8cf]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9ee65f-3572-4d19-87b2-2eceed25e81c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be (non-flash)
Aug 17 20:01:38 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:38 user nova-compute[72815]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be (non-flash)
Aug 17 20:01:38 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] HCTL ('40', '-', '-', 0) found on session 24 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4edf640-4f6e-46f6-a75b-1e7f244560d9]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Searching for a device in session 24 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVUREweg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-f9eb662c-e55f-4736-beae-7fe6dac4d1ce req-b0147e2d-0fc7-4d8c-bf42-7bc9fec8cd2c service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f9eb662c-e55f-4736-beae-7fe6dac4d1ce req-b0147e2d-0fc7-4d8c-bf42-7bc9fec8cd2c service nova] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f9eb662c-e55f-4736-beae-7fe6dac4d1ce req-b0147e2d-0fc7-4d8c-bf42-7bc9fec8cd2c service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f9eb662c-e55f-4736-beae-7fe6dac4d1ce req-b0147e2d-0fc7-4d8c-bf42-7bc9fec8cd2c service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-f9eb662c-e55f-4736-beae-7fe6dac4d1ce req-b0147e2d-0fc7-4d8c-bf42-7bc9fec8cd2c service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] No waiting events found dispatching network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:39 user nova-compute[72815]: WARNING nova.compute.manager [req-f9eb662c-e55f-4736-beae-7fe6dac4d1ce req-b0147e2d-0fc7-4d8c-bf42-7bc9fec8cd2c service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received unexpected event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e for instance with vm_state stopped and task_state powering-on.
Aug 17 20:01:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26432343931356537', 'path': '/dev/sdi'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432343931356537', 'path': '/dev/sdi'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lazy-loading 'flavor' on Instance uuid a5f4e2b3-6d84-418d-9109-07a4362b4d7b {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:01:39 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:01:39 user nova-compute[72815]:   <source dev="/dev/sdi"/>
Aug 17 20:01:39 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:01:39 user nova-compute[72815]:   <serial>c5548c96-7a41-4285-942d-a284fd6e93be</serial>
Aug 17 20:01:39 user nova-compute[72815]: </disk>
Aug 17 20:01:39 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:01:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] No VIF found with MAC fa:16:3e:ed:51:37, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:01:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bd03d614-0860-4361-a64a-f73d0b550e58 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.609s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:41 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302501.0881479, 1800ab7b-dd88-45fb-9370-1b77b8cbf893 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:01:41 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] VM Resumed (Lifecycle Event)
Aug 17 20:01:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:01:41 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance rebooted successfully.
Aug 17 20:01:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f6ec4935-e347-48e7-bcdd-2afd350a92bb tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:01:41 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 20:01:41 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302501.089325, 1800ab7b-dd88-45fb-9370-1b77b8cbf893 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:01:41 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] VM Started (Lifecycle Event)
Aug 17 20:01:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:01:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-b6c902a6-3f2e-4159-a60b-6c818fffe381 req-6b166966-9d38-4850-aaca-ecefc210b710 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b6c902a6-3f2e-4159-a60b-6c818fffe381 req-6b166966-9d38-4850-aaca-ecefc210b710 service nova] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b6c902a6-3f2e-4159-a60b-6c818fffe381 req-6b166966-9d38-4850-aaca-ecefc210b710 service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b6c902a6-3f2e-4159-a60b-6c818fffe381 req-6b166966-9d38-4850-aaca-ecefc210b710 service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-b6c902a6-3f2e-4159-a60b-6c818fffe381 req-6b166966-9d38-4850-aaca-ecefc210b710 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] No waiting events found dispatching network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:41 user nova-compute[72815]: WARNING nova.compute.manager [req-b6c902a6-3f2e-4159-a60b-6c818fffe381 req-6b166966-9d38-4850-aaca-ecefc210b710 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received unexpected event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e for instance with vm_state active and task_state None.
Aug 17 20:01:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:42 user nova-compute[72815]: INFO nova.compute.manager [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Detaching volume c5548c96-7a41-4285-942d-a284fd6e93be
Aug 17 20:01:42 user nova-compute[72815]: INFO nova.virt.block_device [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Attempting to driver detach volume c5548c96-7a41-4285-942d-a284fd6e93be from mountpoint /dev/vdb
Aug 17 20:01:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Attempting to detach device vdb from instance a5f4e2b3-6d84-418d-9109-07a4362b4d7b from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:01:42 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:01:42 user nova-compute[72815]:   <source dev="/dev/sdi"/>
Aug 17 20:01:42 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:01:42 user nova-compute[72815]:   <serial>c5548c96-7a41-4285-942d-a284fd6e93be</serial>
Aug 17 20:01:42 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:01:42 user nova-compute[72815]: </disk>
Aug 17 20:01:42 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:01:42 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Successfully detached device vdb from instance a5f4e2b3-6d84-418d-9109-07a4362b4d7b from the persistent domain config.
Aug 17 20:01:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5f4e2b3-6d84-418d-9109-07a4362b4d7b from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:01:42 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:01:42 user nova-compute[72815]:   <source dev="/dev/sdi"/>
Aug 17 20:01:42 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:01:42 user nova-compute[72815]:   <serial>c5548c96-7a41-4285-942d-a284fd6e93be</serial>
Aug 17 20:01:42 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:01:42 user nova-compute[72815]: </disk>
Aug 17 20:01:42 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302502.838812, a5f4e2b3-6d84-418d-9109-07a4362b4d7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5f4e2b3-6d84-418d-9109-07a4362b4d7b {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:01:42 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Successfully detached device vdb from instance a5f4e2b3-6d84-418d-9109-07a4362b4d7b from the live domain config.
Aug 17 20:01:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVUREweg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:01:42 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:01:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c93ddf-1f2c-49f8-bf90-63fa7d7e848e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b16a63-7a4a-4dad-9dfb-adab35ef0d5e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be (non-flash)
Aug 17 20:01:42 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:42 user nova-compute[72815]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be (non-flash)
Aug 17 20:01:42 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399444f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be'): ({'sdi'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Removing single pathed devices sdi {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dde670-7d4b-4b44-9321-c0e94848d855]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5f477c-90d3-448a-8740-ab97d4e1ec3c]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Flushing IO for device /dev/sdi {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:01:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dce2c4a-f104-41c8-b3ca-3aac9b5a297f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf58826d-4b6f-4ec3-9e1c-6ad15aa9dfc3]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] SCSI volumes sdi have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[71125215-2145-44c5-80a9-6bfec190b4bf]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7f55a9-d362-4394-8fd1-35001f86e5be]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be, portal: 172.16.0.220,3260]
Aug 17 20:01:43 user nova-compute[72815]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be, portal: 172.16.0.220,3260] successful.
Aug 17 20:01:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5548c96-7a41-4285-942d-a284fd6e93be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf965eb-ed7e-42bc-b088-e21f92eacc19]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] <== disconnect_volume: return (344ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-250a247f-dd17-45f6-9283-79f1e91bc8fd req-fae64a1b-f4c4-41d1-8053-5082fd88a458 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-changed-431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-250a247f-dd17-45f6-9283-79f1e91bc8fd req-fae64a1b-f4c4-41d1-8053-5082fd88a458 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing instance network info cache due to event network-changed-431a8b0e-fe6d-4805-9456-7a75a9cc7efe. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-250a247f-dd17-45f6-9283-79f1e91bc8fd req-fae64a1b-f4c4-41d1-8053-5082fd88a458 service nova] Acquiring lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-250a247f-dd17-45f6-9283-79f1e91bc8fd req-fae64a1b-f4c4-41d1-8053-5082fd88a458 service nova] Acquired lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG nova.network.neutron [req-250a247f-dd17-45f6-9283-79f1e91bc8fd req-fae64a1b-f4c4-41d1-8053-5082fd88a458 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Refreshing network info cache for port 431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG nova.network.neutron [req-250a247f-dd17-45f6-9283-79f1e91bc8fd req-fae64a1b-f4c4-41d1-8053-5082fd88a458 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updated VIF entry in instance network info cache for port 431a8b0e-fe6d-4805-9456-7a75a9cc7efe. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG nova.network.neutron [req-250a247f-dd17-45f6-9283-79f1e91bc8fd req-fae64a1b-f4c4-41d1-8053-5082fd88a458 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [{"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "address": "fa:16:3e:26:ef:49", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22dad22-87", "ovs_interfaceid": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1ace327-2298-4cd7-b9ae-40656e87871b", "address": "fa:16:3e:d7:d5:73", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace327-22", "ovs_interfaceid": "c1ace327-2298-4cd7-b9ae-40656e87871b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-250a247f-dd17-45f6-9283-79f1e91bc8fd req-fae64a1b-f4c4-41d1-8053-5082fd88a458 service nova] Releasing lock "refresh_cache-03a874db-ce51-4502-839d-7cf9ff2f9259" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:01:44 user nova-compute[72815]: DEBUG nova.objects.instance [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lazy-loading 'flavor' on Instance uuid a5f4e2b3-6d84-418d-9109-07a4362b4d7b {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b0fc7eab-7d48-4ce6-93bb-4f5fff363d0f tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.949s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:45 user nova-compute[72815]: INFO nova.compute.manager [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Terminating instance
Aug 17 20:01:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-733f4cca-880c-42b6-8d2e-71926bff2922 req-8930b244-2f43-4933-bda5-782a0859f0e2 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-733f4cca-880c-42b6-8d2e-71926bff2922 req-8930b244-2f43-4933-bda5-782a0859f0e2 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-733f4cca-880c-42b6-8d2e-71926bff2922 req-8930b244-2f43-4933-bda5-782a0859f0e2 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-733f4cca-880c-42b6-8d2e-71926bff2922 req-8930b244-2f43-4933-bda5-782a0859f0e2 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-733f4cca-880c-42b6-8d2e-71926bff2922 req-8930b244-2f43-4933-bda5-782a0859f0e2 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-unplugged-431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-733f4cca-880c-42b6-8d2e-71926bff2922 req-8930b244-2f43-4933-bda5-782a0859f0e2 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-431a8b0e-fe6d-4805-9456-7a75a9cc7efe for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-ecf7b61e-4ced-42c9-ab85-9aed23059cf5 req-8f994e30-1d34-4f57-9d24-faa9084f2ef2 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-8cb05478-e8f0-4130-9263-89b3b569bf41 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ecf7b61e-4ced-42c9-ab85-9aed23059cf5 req-8f994e30-1d34-4f57-9d24-faa9084f2ef2 service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ecf7b61e-4ced-42c9-ab85-9aed23059cf5 req-8f994e30-1d34-4f57-9d24-faa9084f2ef2 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ecf7b61e-4ced-42c9-ab85-9aed23059cf5 req-8f994e30-1d34-4f57-9d24-faa9084f2ef2 service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-ecf7b61e-4ced-42c9-ab85-9aed23059cf5 req-8f994e30-1d34-4f57-9d24-faa9084f2ef2 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-unplugged-8cb05478-e8f0-4130-9263-89b3b569bf41 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-ecf7b61e-4ced-42c9-ab85-9aed23059cf5 req-8f994e30-1d34-4f57-9d24-faa9084f2ef2 service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-8cb05478-e8f0-4130-9263-89b3b569bf41 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-641fd431-404d-4ea3-a5be-caecfdd989b9 req-9b46f690-d5a1-4e3f-8fa2-b3f8b0037d0f service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-2730732d-913e-4e70-b1ac-69acd53e9bac {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-641fd431-404d-4ea3-a5be-caecfdd989b9 req-9b46f690-d5a1-4e3f-8fa2-b3f8b0037d0f service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-641fd431-404d-4ea3-a5be-caecfdd989b9 req-9b46f690-d5a1-4e3f-8fa2-b3f8b0037d0f service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-641fd431-404d-4ea3-a5be-caecfdd989b9 req-9b46f690-d5a1-4e3f-8fa2-b3f8b0037d0f service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-641fd431-404d-4ea3-a5be-caecfdd989b9 req-9b46f690-d5a1-4e3f-8fa2-b3f8b0037d0f service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-unplugged-2730732d-913e-4e70-b1ac-69acd53e9bac {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-641fd431-404d-4ea3-a5be-caecfdd989b9 req-9b46f690-d5a1-4e3f-8fa2-b3f8b0037d0f service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-2730732d-913e-4e70-b1ac-69acd53e9bac for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:47 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Instance destroyed successfully.
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.objects.instance [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lazy-loading 'resources' on Instance uuid 03a874db-ce51-4502-839d-7cf9ff2f9259 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:f1:21,bridge_name='br-int',has_traffic_filtering=True,id=431a8b0e-fe6d-4805-9456-7a75a9cc7efe,network=Network(6f15f961-c367-400e-9099-e88fe115c67f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431a8b0e-fe') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:f1:21,bridge_name='br-int',has_traffic_filtering=True,id=431a8b0e-fe6d-4805-9456-7a75a9cc7efe,network=Network(6f15f961-c367-400e-9099-e88fe115c67f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431a8b0e-fe') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap431a8b0e-fe, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: INFO os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:f1:21,bridge_name='br-int',has_traffic_filtering=True,id=431a8b0e-fe6d-4805-9456-7a75a9cc7efe,network=Network(6f15f961-c367-400e-9099-e88fe115c67f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431a8b0e-fe')
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:ea,bridge_name='br-int',has_traffic_filtering=True,id=2730732d-913e-4e70-b1ac-69acd53e9bac,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2730732d-91') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:ea,bridge_name='br-int',has_traffic_filtering=True,id=2730732d-913e-4e70-b1ac-69acd53e9bac,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2730732d-91') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2730732d-91, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:01:47 user nova-compute[72815]: INFO nova.compute.claims [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Claim successful on node user
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: INFO os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:ea,bridge_name='br-int',has_traffic_filtering=True,id=2730732d-913e-4e70-b1ac-69acd53e9bac,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2730732d-91')
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:10:68,bridge_name='br-int',has_traffic_filtering=True,id=8cb05478-e8f0-4130-9263-89b3b569bf41,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8cb05478-e8') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:10:68,bridge_name='br-int',has_traffic_filtering=True,id=8cb05478-e8f0-4130-9263-89b3b569bf41,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8cb05478-e8') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cb05478-e8, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: INFO os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:10:68,bridge_name='br-int',has_traffic_filtering=True,id=8cb05478-e8f0-4130-9263-89b3b569bf41,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8cb05478-e8')
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "address": "fa:16:3e:26:ef:49", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22dad22-87", "ovs_interfaceid": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "address": "fa:16:3e:26:ef:49", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22dad22-87", "ovs_interfaceid": "a22dad22-87fa-4b9c-866a-6c4c29c2d1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ef:49,bridge_name='br-int',has_traffic_filtering=True,id=a22dad22-87fa-4b9c-866a-6c4c29c2d1b2,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22dad22-87') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ef:49,bridge_name='br-int',has_traffic_filtering=True,id=a22dad22-87fa-4b9c-866a-6c4c29c2d1b2,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22dad22-87') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa22dad22-87, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: INFO os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ef:49,bridge_name='br-int',has_traffic_filtering=True,id=a22dad22-87fa-4b9c-866a-6c4c29c2d1b2,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22dad22-87')
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:dc:44,bridge_name='br-int',has_traffic_filtering=True,id=2f92bde6-dd64-4c9c-b317-75cb5f984cc3,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92bde6-dd') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:dc:44,bridge_name='br-int',has_traffic_filtering=True,id=2f92bde6-dd64-4c9c-b317-75cb5f984cc3,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92bde6-dd') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f92bde6-dd, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: INFO os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:dc:44,bridge_name='br-int',has_traffic_filtering=True,id=2f92bde6-dd64-4c9c-b317-75cb5f984cc3,network=Network(1b8e61e2-b3f2-4ae2-93b3-c683550c7451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92bde6-dd')
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1ace327-2298-4cd7-b9ae-40656e87871b", "address": "fa:16:3e:d7:d5:73", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace327-22", "ovs_interfaceid": "c1ace327-2298-4cd7-b9ae-40656e87871b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "c1ace327-2298-4cd7-b9ae-40656e87871b", "address": "fa:16:3e:d7:d5:73", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace327-22", "ovs_interfaceid": "c1ace327-2298-4cd7-b9ae-40656e87871b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=c1ace327-2298-4cd7-b9ae-40656e87871b,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace327-22') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=c1ace327-2298-4cd7-b9ae-40656e87871b,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace327-22') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1ace327-22, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: INFO os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=c1ace327-2298-4cd7-b9ae-40656e87871b,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace327-22')
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T19:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-338351860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-338351860',id=18,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn+0Jo/65jec39I51Q8VxZfs1jEsmziy7r0BNiU86cQT6CM5DKN3CrB0OfjgmM/s1HCIOm8epA/7pSezKhHUGEAlHmOfV281QCHYIHKe7ae+11X/Q2cEd7v4jOGSgbdaQ==',key_name='tempest-keypair-1800152433',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2f87cb80bdf4526972d9466d518b922',ramdisk_id='',reservation_id='r-jq4k00s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-69187056',owner_user_name='tempest-TaggedBootDevicesTest_v242-69187056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3bc2718d43d190e10a0c170cd889',uuid=03a874db-ce51-4502-839d-7cf9ff2f9259,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converting VIF {"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:9a:61,bridge_name='br-int',has_traffic_filtering=True,id=55be58dc-83ce-4144-b1f2-b18d8750e613,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55be58dc-83') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:9a:61,bridge_name='br-int',has_traffic_filtering=True,id=55be58dc-83ce-4144-b1f2-b18d8750e613,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55be58dc-83') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55be58dc-83, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:01:47 user nova-compute[72815]: INFO os_vif [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:9a:61,bridge_name='br-int',has_traffic_filtering=True,id=55be58dc-83ce-4144-b1f2-b18d8750e613,network=Network(18926b60-d60d-421b-b4ac-3ef99a34e2dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55be58dc-83')
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emdriUtY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:01:47 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:01:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:47 user nova-compute[72815]: WARNING nova.compute.manager [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-431a8b0e-fe6d-4805-9456-7a75a9cc7efe for instance with vm_state active and task_state deleting.
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-unplugged-c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-c1ace327-2298-4cd7-b9ae-40656e87871b for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:47 user nova-compute[72815]: WARNING nova.compute.manager [req-586d3eb4-5002-4987-856f-fb81db1e5238 req-9b5668ee-f790-4140-bb94-243c1c04085e service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-c1ace327-2298-4cd7-b9ae-40656e87871b for instance with vm_state active and task_state deleting.
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a103ea4-b1e8-4752-8e15-394659eb69fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02b096b-004f-43b9-9973-2269cb134b2c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399434a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe'): ({'sdb'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Removing single pathed devices sdb {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e78b4c-945c-40de-85f4-c0de7f62bca7]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6a6a1c-6308-46b3-9c5b-02a53ad82e8f]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Flushing IO for device /dev/sdb {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e5ebc4-65c5-4b78-9571-15ab5c1edac4]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.083s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d07eb13-572a-4ed6-b64c-12349bf22dd9]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-8cb05478-e8f0-4130-9263-89b3b569bf41 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-8cb05478-e8f0-4130-9263-89b3b569bf41 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:48 user nova-compute[72815]: WARNING nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-8cb05478-e8f0-4130-9263-89b3b569bf41 for instance with vm_state active and task_state deleting.
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-unplugged-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:48 user nova-compute[72815]: WARNING nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 for instance with vm_state active and task_state deleting.
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-unplugged-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:48 user nova-compute[72815]: WARNING nova.compute.manager [req-54e85570-efe4-4fa3-8622-b19abed9775a req-86b1ab89-2100-4311-823f-5f43806c930d service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 for instance with vm_state active and task_state deleting.
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ce98f3-a26a-42b9-8e61-b50fa2d4a458]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdf146e-7701-41d0-9629-8ff62b0bf45b]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe, portal: 172.16.0.220,3260]
Aug 17 20:01:48 user nova-compute[72815]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe, portal: 172.16.0.220,3260] successful.
Aug 17 20:01:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.669s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3094f0-c65a-4888-8928-93bd3dcc63fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24623b6d-c212-4eb3-b8cf-7780a2c98f2a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] <== disconnect_volume: return (404ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvzANDBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:01:48 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fabfc65-65ed-498f-b8be-6fbf4c775327]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:01:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3b4f8d-17d4-4eb5-840b-5d4c9f8ecd5b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944771c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae'): ({'sde'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Removing single pathed devices sde {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e028dc8-f7b7-4884-91e6-6e8eb69a1929]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55ef72c-fa44-4d30-b092-c82e3ce879b3]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Flushing IO for device /dev/sde {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d2ecca-d566-4860-9a7b-82b9ab26d2a8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.policy [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '783d6f5af68c4efe83fb8574f129882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520c959f1a5480293b0c8f501da0dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ed61e8-e8b6-4179-bd0c-c39759f43e31]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:01:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Creating image(s)
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "/opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "/opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "/opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8f9812-f679-4c31-a951-32d0bf307c65]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2873d64-ff44-4d46-bf2c-f3e4ee10e211]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae, portal: 172.16.0.220,3260]
Aug 17 20:01:48 user nova-compute[72815]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae, portal: 172.16.0.220,3260] successful.
Aug 17 20:01:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a6f3da3-5bf8-4ffb-9353-3daebd00f0ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[085c49c1-06f2-437e-a0bc-444ec71e9e51]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] <== disconnect_volume: return (379ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIJEpKiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:01:48 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.191s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[444efa20-974b-4e9e-b491-dee66e1f19c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2cca10-daa8-49c0-9873-8cb8bac056a7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:01:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994484b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d'): ({'sdf'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Removing single pathed devices sdf {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f59de2b-0cf2-4dac-b3ef-e992ad9ffe6d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3269b71e-f8b3-4850-8126-bbd39de7ad4b]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Flushing IO for device /dev/sdf {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.168s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[609ebafb-b836-4f79-bcc3-a014c6c7e65a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk 1073741824" returned: 0 in 0.051s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0379ad54-e3cd-4381-a490-72426f7960bd]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[379370c2-29c3-455f-be9e-cc98c4b2f682]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b241234-7de0-4262-a4e3-66d995dd0779]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d, portal: 172.16.0.220,3260]
Aug 17 20:01:49 user nova-compute[72815]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d, portal: 172.16.0.220,3260] successful.
Aug 17 20:01:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443cbc27-a597-4636-8ae6-31f8cc49009d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7528d3c4-26f0-437d-9477-ea66e8e73135]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] <== disconnect_volume: return (401ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:01:49 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Deleting instance files /opt/stack/data/nova/instances/03a874db-ce51-4502-839d-7cf9ff2f9259_del
Aug 17 20:01:49 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Deletion of /opt/stack/data/nova/instances/03a874db-ce51-4502-839d-7cf9ff2f9259_del complete
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.202s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-2730732d-913e-4e70-b1ac-69acd53e9bac {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-2730732d-913e-4e70-b1ac-69acd53e9bac {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:49 user nova-compute[72815]: WARNING nova.compute.manager [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-2730732d-913e-4e70-b1ac-69acd53e9bac for instance with vm_state active and task_state deleting.
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-unplugged-55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-unplugged-55be58dc-83ce-4144-b1f2-b18d8750e613 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-plugged-55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] Acquiring lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] No waiting events found dispatching network-vif-plugged-55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:49 user nova-compute[72815]: WARNING nova.compute.manager [req-99465af9-0175-44df-a5b2-f7bdf5f6f4fe req-72112730-9fcf-4f48-972f-c9670fc89d6b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received unexpected event network-vif-plugged-55be58dc-83ce-4144-b1f2-b18d8750e613 for instance with vm_state active and task_state deleting.
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Successfully created port: 75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:01:49 user nova-compute[72815]: INFO nova.compute.manager [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Took 3.81 seconds to destroy the instance on the hypervisor.
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Cannot resize image /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lazy-loading 'migration_context' on Instance uuid 71e8c292-6412-4079-8a2c-11c65c808588 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Ensure instance console log exists: /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Successfully updated port: 75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "refresh_cache-71e8c292-6412-4079-8a2c-11c65c808588" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquired lock "refresh_cache-71e8c292-6412-4079-8a2c-11c65c808588" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-4a88d63d-e87d-489a-afb7-11a5734cb85c req-e2bfd4db-e7fe-4ccb-b686-b6d4ee8d8b0f service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Received event network-changed-75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-4a88d63d-e87d-489a-afb7-11a5734cb85c req-e2bfd4db-e7fe-4ccb-b686-b6d4ee8d8b0f service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Refreshing instance network info cache due to event network-changed-75f40a91-a6d6-45b0-8146-b63ed8690498. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4a88d63d-e87d-489a-afb7-11a5734cb85c req-e2bfd4db-e7fe-4ccb-b686-b6d4ee8d8b0f service nova] Acquiring lock "refresh_cache-71e8c292-6412-4079-8a2c-11c65c808588" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Updating instance_info_cache with network_info: [{"id": "75f40a91-a6d6-45b0-8146-b63ed8690498", "address": "fa:16:3e:9d:8b:8a", "network": {"id": "4d7c633c-edae-419d-823d-f83bfc69b641", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1851083827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520c959f1a5480293b0c8f501da0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f40a91-a6", "ovs_interfaceid": "75f40a91-a6d6-45b0-8146-b63ed8690498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Releasing lock "refresh_cache-71e8c292-6412-4079-8a2c-11c65c808588" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Instance network_info: |[{"id": "75f40a91-a6d6-45b0-8146-b63ed8690498", "address": "fa:16:3e:9d:8b:8a", "network": {"id": "4d7c633c-edae-419d-823d-f83bfc69b641", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1851083827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520c959f1a5480293b0c8f501da0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f40a91-a6", "ovs_interfaceid": "75f40a91-a6d6-45b0-8146-b63ed8690498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4a88d63d-e87d-489a-afb7-11a5734cb85c req-e2bfd4db-e7fe-4ccb-b686-b6d4ee8d8b0f service nova] Acquired lock "refresh_cache-71e8c292-6412-4079-8a2c-11c65c808588" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-4a88d63d-e87d-489a-afb7-11a5734cb85c req-e2bfd4db-e7fe-4ccb-b686-b6d4ee8d8b0f service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Refreshing network info cache for port 75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Start _get_guest_xml network_info=[{"id": "75f40a91-a6d6-45b0-8146-b63ed8690498", "address": "fa:16:3e:9d:8b:8a", "network": {"id": "4d7c633c-edae-419d-823d-f83bfc69b641", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1851083827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520c959f1a5480293b0c8f501da0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f40a91-a6", "ovs_interfaceid": "75f40a91-a6d6-45b0-8146-b63ed8690498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:01:50 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:01:50 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-242370575',display_name='tempest-TestServerVolumeAttachmentScenario-server-242370575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-242370575',id=22,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoBVbMx2raNF0AqTw51Fef49/Xz5GWR9t9CcFBY08XKOcj8ZDyO/Wx9IoVtAaX1Jy+7AcPGu0djvA1/aRjBgKx/7fnM4seRPfHjIV5g3/FlJa2MoC8olXEWTIFbIr7C5w==',key_name='tempest-keypair-1710876700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0520c959f1a5480293b0c8f501da0dd3',ramdisk_id='',reservation_id='r-63ro1bh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-599186245',owner_user_name='tempest-TestServerVolumeAttachmentScenario-599186245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='783d6f5af68c4efe83fb8574f129882d',uuid=71e8c292-6412-4079-8a2c-11c65c808588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75f40a91-a6d6-45b0-8146-b63ed8690498", "address": "fa:16:3e:9d:8b:8a", "network": {"id": "4d7c633c-edae-419d-823d-f83bfc69b641", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1851083827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520c959f1a5480293b0c8f501da0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f40a91-a6", "ovs_interfaceid": "75f40a91-a6d6-45b0-8146-b63ed8690498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Converting VIF {"id": "75f40a91-a6d6-45b0-8146-b63ed8690498", "address": "fa:16:3e:9d:8b:8a", "network": {"id": "4d7c633c-edae-419d-823d-f83bfc69b641", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1851083827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520c959f1a5480293b0c8f501da0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f40a91-a6", "ovs_interfaceid": "75f40a91-a6d6-45b0-8146-b63ed8690498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=75f40a91-a6d6-45b0-8146-b63ed8690498,network=Network(4d7c633c-edae-419d-823d-f83bfc69b641),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f40a91-a6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lazy-loading 'pci_devices' on Instance uuid 71e8c292-6412-4079-8a2c-11c65c808588 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:01:50 user nova-compute[72815]:   <uuid>71e8c292-6412-4079-8a2c-11c65c808588</uuid>
Aug 17 20:01:50 user nova-compute[72815]:   <name>instance-00000016</name>
Aug 17 20:01:50 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:01:50 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:01:50 user nova-compute[72815]:   <metadata>
Aug 17 20:01:50 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:01:50 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:01:50 user nova-compute[72815]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-242370575</nova:name>
Aug 17 20:01:50 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:01:50</nova:creationTime>
Aug 17 20:01:50 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:01:50 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:01:50 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:01:50 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:01:50 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:01:50 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:01:50 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:01:50 user nova-compute[72815]:       <nova:owner>
Aug 17 20:01:50 user nova-compute[72815]:         <nova:user uuid="783d6f5af68c4efe83fb8574f129882d">tempest-TestServerVolumeAttachmentScenario-599186245-project-member</nova:user>
Aug 17 20:01:50 user nova-compute[72815]:         <nova:project uuid="0520c959f1a5480293b0c8f501da0dd3">tempest-TestServerVolumeAttachmentScenario-599186245</nova:project>
Aug 17 20:01:50 user nova-compute[72815]:       </nova:owner>
Aug 17 20:01:50 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:01:50 user nova-compute[72815]:       <nova:ports>
Aug 17 20:01:50 user nova-compute[72815]:         <nova:port uuid="75f40a91-a6d6-45b0-8146-b63ed8690498">
Aug 17 20:01:50 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 20:01:50 user nova-compute[72815]:         </nova:port>
Aug 17 20:01:50 user nova-compute[72815]:       </nova:ports>
Aug 17 20:01:50 user nova-compute[72815]:     </nova:instance>
Aug 17 20:01:50 user nova-compute[72815]:   </metadata>
Aug 17 20:01:50 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:01:50 user nova-compute[72815]:     <system>
Aug 17 20:01:50 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:01:50 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:01:50 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:01:50 user nova-compute[72815]:       <entry name="serial">71e8c292-6412-4079-8a2c-11c65c808588</entry>
Aug 17 20:01:50 user nova-compute[72815]:       <entry name="uuid">71e8c292-6412-4079-8a2c-11c65c808588</entry>
Aug 17 20:01:50 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:01:50 user nova-compute[72815]:     </system>
Aug 17 20:01:50 user nova-compute[72815]:   </sysinfo>
Aug 17 20:01:50 user nova-compute[72815]:   <os>
Aug 17 20:01:50 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:01:50 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:01:50 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:01:50 user nova-compute[72815]:   </os>
Aug 17 20:01:50 user nova-compute[72815]:   <features>
Aug 17 20:01:50 user nova-compute[72815]:     <acpi/>
Aug 17 20:01:50 user nova-compute[72815]:     <apic/>
Aug 17 20:01:50 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:01:50 user nova-compute[72815]:   </features>
Aug 17 20:01:50 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:01:50 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:01:50 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:01:50 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:01:50 user nova-compute[72815]:   </clock>
Aug 17 20:01:50 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:01:50 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:01:50 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:01:50 user nova-compute[72815]:   </cpu>
Aug 17 20:01:50 user nova-compute[72815]:   <devices>
Aug 17 20:01:50 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:01:50 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:01:50 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk"/>
Aug 17 20:01:50 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:01:50 user nova-compute[72815]:     </disk>
Aug 17 20:01:50 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:01:50 user nova-compute[72815]:       <mac address="fa:16:3e:9d:8b:8a"/>
Aug 17 20:01:50 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:01:50 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:01:50 user nova-compute[72815]:       <target dev="tap75f40a91-a6"/>
Aug 17 20:01:50 user nova-compute[72815]:     </interface>
Aug 17 20:01:50 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:01:50 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/console.log" append="off"/>
Aug 17 20:01:50 user nova-compute[72815]:     </serial>
Aug 17 20:01:50 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:01:50 user nova-compute[72815]:     <video>
Aug 17 20:01:50 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:01:50 user nova-compute[72815]:     </video>
Aug 17 20:01:50 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:01:50 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:01:50 user nova-compute[72815]:     </rng>
Aug 17 20:01:50 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:01:50 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:01:50 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:01:50 user nova-compute[72815]:     </memballoon>
Aug 17 20:01:50 user nova-compute[72815]:   </devices>
Aug 17 20:01:50 user nova-compute[72815]: </domain>
Aug 17 20:01:50 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-242370575',display_name='tempest-TestServerVolumeAttachmentScenario-server-242370575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-242370575',id=22,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoBVbMx2raNF0AqTw51Fef49/Xz5GWR9t9CcFBY08XKOcj8ZDyO/Wx9IoVtAaX1Jy+7AcPGu0djvA1/aRjBgKx/7fnM4seRPfHjIV5g3/FlJa2MoC8olXEWTIFbIr7C5w==',key_name='tempest-keypair-1710876700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0520c959f1a5480293b0c8f501da0dd3',ramdisk_id='',reservation_id='r-63ro1bh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-599186245',owner_user_name='tempest-TestServerVolumeAttachmentScenario-599186245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='783d6f5af68c4efe83fb8574f129882d',uuid=71e8c292-6412-4079-8a2c-11c65c808588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75f40a91-a6d6-45b0-8146-b63ed8690498", "address": "fa:16:3e:9d:8b:8a", "network": {"id": "4d7c633c-edae-419d-823d-f83bfc69b641", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1851083827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520c959f1a5480293b0c8f501da0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f40a91-a6", "ovs_interfaceid": "75f40a91-a6d6-45b0-8146-b63ed8690498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Converting VIF {"id": "75f40a91-a6d6-45b0-8146-b63ed8690498", "address": "fa:16:3e:9d:8b:8a", "network": {"id": "4d7c633c-edae-419d-823d-f83bfc69b641", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1851083827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520c959f1a5480293b0c8f501da0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f40a91-a6", "ovs_interfaceid": "75f40a91-a6d6-45b0-8146-b63ed8690498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=75f40a91-a6d6-45b0-8146-b63ed8690498,network=Network(4d7c633c-edae-419d-823d-f83bfc69b641),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f40a91-a6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG os_vif [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=75f40a91-a6d6-45b0-8146-b63ed8690498,network=Network(4d7c633c-edae-419d-823d-f83bfc69b641),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f40a91-a6') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75f40a91-a6, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75f40a91-a6, col_values=(('external_ids', {'iface-id': '75f40a91-a6d6-45b0-8146-b63ed8690498', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:8b:8a', 'vm-uuid': '71e8c292-6412-4079-8a2c-11c65c808588'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:50 user nova-compute[72815]: INFO os_vif [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=75f40a91-a6d6-45b0-8146-b63ed8690498,network=Network(4d7c633c-edae-419d-823d-f83bfc69b641),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f40a91-a6')
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:01:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] No VIF found with MAC fa:16:3e:9d:8b:8a, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:01:51 user nova-compute[72815]: DEBUG nova.network.neutron [req-4a88d63d-e87d-489a-afb7-11a5734cb85c req-e2bfd4db-e7fe-4ccb-b686-b6d4ee8d8b0f service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Updated VIF entry in instance network info cache for port 75f40a91-a6d6-45b0-8146-b63ed8690498. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:01:51 user nova-compute[72815]: DEBUG nova.network.neutron [req-4a88d63d-e87d-489a-afb7-11a5734cb85c req-e2bfd4db-e7fe-4ccb-b686-b6d4ee8d8b0f service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Updating instance_info_cache with network_info: [{"id": "75f40a91-a6d6-45b0-8146-b63ed8690498", "address": "fa:16:3e:9d:8b:8a", "network": {"id": "4d7c633c-edae-419d-823d-f83bfc69b641", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1851083827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520c959f1a5480293b0c8f501da0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f40a91-a6", "ovs_interfaceid": "75f40a91-a6d6-45b0-8146-b63ed8690498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4a88d63d-e87d-489a-afb7-11a5734cb85c req-e2bfd4db-e7fe-4ccb-b686-b6d4ee8d8b0f service nova] Releasing lock "refresh_cache-71e8c292-6412-4079-8a2c-11c65c808588" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:01:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:51 user nova-compute[72815]: DEBUG nova.compute.manager [req-33ce05bf-8222-4051-b61b-63b3903c1be7 req-207f775f-37d1-482e-90de-cf6ace44f07a service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-deleted-a22dad22-87fa-4b9c-866a-6c4c29c2d1b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:51 user nova-compute[72815]: INFO nova.compute.manager [req-33ce05bf-8222-4051-b61b-63b3903c1be7 req-207f775f-37d1-482e-90de-cf6ace44f07a service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Neutron deleted interface a22dad22-87fa-4b9c-866a-6c4c29c2d1b2; detaching it from the instance and deleting it from the info cache
Aug 17 20:01:51 user nova-compute[72815]: DEBUG nova.network.neutron [req-33ce05bf-8222-4051-b61b-63b3903c1be7 req-207f775f-37d1-482e-90de-cf6ace44f07a service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [{"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1ace327-2298-4cd7-b9ae-40656e87871b", "address": "fa:16:3e:d7:d5:73", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace327-22", "ovs_interfaceid": "c1ace327-2298-4cd7-b9ae-40656e87871b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:51 user nova-compute[72815]: DEBUG nova.compute.manager [req-33ce05bf-8222-4051-b61b-63b3903c1be7 req-207f775f-37d1-482e-90de-cf6ace44f07a service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Detach interface failed, port_id=a22dad22-87fa-4b9c-866a-6c4c29c2d1b2, reason: Instance 03a874db-ce51-4502-839d-7cf9ff2f9259 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:01:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-deleted-c1ace327-2298-4cd7-b9ae-40656e87871b {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:53 user nova-compute[72815]: INFO nova.compute.manager [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Neutron deleted interface c1ace327-2298-4cd7-b9ae-40656e87871b; detaching it from the instance and deleting it from the info cache
Aug 17 20:01:53 user nova-compute[72815]: DEBUG nova.network.neutron [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [{"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55be58dc-83ce-4144-b1f2-b18d8750e613", "address": "fa:16:3e:4d:9a:61", "network": {"id": "18926b60-d60d-421b-b4ac-3ef99a34e2dd", "bridge": "br-int", "label": "tempest-device-tagging-net2-824562732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55be58dc-83", "ovs_interfaceid": "55be58dc-83ce-4144-b1f2-b18d8750e613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Detach interface failed, port_id=c1ace327-2298-4cd7-b9ae-40656e87871b, reason: Instance 03a874db-ce51-4502-839d-7cf9ff2f9259 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Received event network-vif-plugged-75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] Lock "71e8c292-6412-4079-8a2c-11c65c808588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] Lock "71e8c292-6412-4079-8a2c-11c65c808588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] No waiting events found dispatching network-vif-plugged-75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:53 user nova-compute[72815]: WARNING nova.compute.manager [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Received unexpected event network-vif-plugged-75f40a91-a6d6-45b0-8146-b63ed8690498 for instance with vm_state building and task_state spawning.
Aug 17 20:01:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-deleted-55be58dc-83ce-4144-b1f2-b18d8750e613 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:53 user nova-compute[72815]: INFO nova.compute.manager [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Neutron deleted interface 55be58dc-83ce-4144-b1f2-b18d8750e613; detaching it from the instance and deleting it from the info cache
Aug 17 20:01:53 user nova-compute[72815]: DEBUG nova.network.neutron [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [{"id": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "address": "fa:16:3e:c8:f1:21", "network": {"id": "6f15f961-c367-400e-9099-e88fe115c67f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1688608257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431a8b0e-fe", "ovs_interfaceid": "431a8b0e-fe6d-4805-9456-7a75a9cc7efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2730732d-913e-4e70-b1ac-69acd53e9bac", "address": "fa:16:3e:3c:c4:ea", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2730732d-91", "ovs_interfaceid": "2730732d-913e-4e70-b1ac-69acd53e9bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8cb05478-e8f0-4130-9263-89b3b569bf41", "address": "fa:16:3e:ce:10:68", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb05478-e8", "ovs_interfaceid": "8cb05478-e8f0-4130-9263-89b3b569bf41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "address": "fa:16:3e:19:dc:44", "network": {"id": "1b8e61e2-b3f2-4ae2-93b3-c683550c7451", "bridge": "br-int", "label": "tempest-device-tagging-net1-1334990290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2f87cb80bdf4526972d9466d518b922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92bde6-dd", "ovs_interfaceid": "2f92bde6-dd64-4c9c-b317-75cb5f984cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Detach interface failed, port_id=55be58dc-83ce-4144-b1f2-b18d8750e613, reason: Instance 03a874db-ce51-4502-839d-7cf9ff2f9259 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Received event network-vif-plugged-75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] Lock "71e8c292-6412-4079-8a2c-11c65c808588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] Lock "71e8c292-6412-4079-8a2c-11c65c808588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] No waiting events found dispatching network-vif-plugged-75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:01:53 user nova-compute[72815]: WARNING nova.compute.manager [req-1fa59076-13b4-4e3e-9a3b-63b41bbf4fe4 req-f93d1c50-0f01-427c-abcd-2a65face631b service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Received unexpected event network-vif-plugged-75f40a91-a6d6-45b0-8146-b63ed8690498 for instance with vm_state building and task_state spawning.
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302514.4648123, 71e8c292-6412-4079-8a2c-11c65c808588 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:01:54 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] VM Resumed (Lifecycle Event)
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:54 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Instance spawned successfully.
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:01:54 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302514.4699972, 71e8c292-6412-4079-8a2c-11c65c808588 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:01:54 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] VM Started (Lifecycle Event)
Aug 17 20:01:54 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Took 5.32 seconds to deallocate network for instance.
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:01:54 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:01:54 user nova-compute[72815]: INFO nova.compute.manager [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 17 20:01:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:01:54 user nova-compute[72815]: INFO nova.compute.manager [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Took 7.13 seconds to build instance.
Aug 17 20:01:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c7af551-c2c4-4cab-8c96-318b3f6e95ce tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.262s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-b55d5504-e414-45a5-884a-e16324afde08 req-70037102-6d70-4e99-a1de-c3363ba9d5de service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-deleted-431a8b0e-fe6d-4805-9456-7a75a9cc7efe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-b55d5504-e414-45a5-884a-e16324afde08 req-70037102-6d70-4e99-a1de-c3363ba9d5de service nova] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Received event network-vif-deleted-2f92bde6-dd64-4c9c-b317-75cb5f984cc3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:01:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:01:57 user nova-compute[72815]: INFO nova.compute.manager [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Took 2.64 seconds to detach 3 volumes for instance.
Aug 17 20:01:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:57 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:01:57 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:01:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:57 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Deleted allocations for instance 03a874db-ce51-4502-839d-7cf9ff2f9259
Aug 17 20:01:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:57 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:01:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-27cf181c-81cf-40ce-91cb-e545b8a813fe tempest-TaggedBootDevicesTest_v242-69187056 tempest-TaggedBootDevicesTest_v242-69187056-project-member] Lock "03a874db-ce51-4502-839d-7cf9ff2f9259" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.469s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:01:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:01:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:01:57 user nova-compute[72815]: INFO nova.compute.claims [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Claim successful on node user
Aug 17 20:01:58 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:01:58 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:01:58 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:01:58 user nova-compute[72815]: INFO nova.virt.block_device [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Booting with volume 14b4030a-a6cd-446d-8014-480d030fabb6 at /dev/vda
Aug 17 20:01:58 user nova-compute[72815]: DEBUG nova.policy [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2b94419b4fc41f7b5303c6f98a503fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eef397b2824b58bafe33616d7c48c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG os_brick.utils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5005683-6f8b-4633-860d-b903bd28be31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[615663e8-a0de-4aa4-bab7-254a5074f038]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5eec7a-1889-4d44-9793-b5678d79fc68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba56362-82ea-4652-a3e7-f719ea13fd8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:01:58 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:01:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a7f655-9359-4639-950c-b17b43a3cb43]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG os_brick.utils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:01:58 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating existing volume attachment record: 1f2bbe0f-fd76-426d-b0d9-7d51d1c0c156 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:01:59 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Successfully created port: 81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Successfully created port: 72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG nova.compute.manager [req-7cb55ed1-2784-43ec-9450-a859c375da9a req-d08a0796-54de-4956-997a-add3034ac5b8 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-changed-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG nova.compute.manager [req-7cb55ed1-2784-43ec-9450-a859c375da9a req-d08a0796-54de-4956-997a-add3034ac5b8 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Refreshing instance network info cache due to event network-changed-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7cb55ed1-2784-43ec-9450-a859c375da9a req-d08a0796-54de-4956-997a-add3034ac5b8 service nova] Acquiring lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7cb55ed1-2784-43ec-9450-a859c375da9a req-d08a0796-54de-4956-997a-add3034ac5b8 service nova] Acquired lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG nova.network.neutron [req-7cb55ed1-2784-43ec-9450-a859c375da9a req-d08a0796-54de-4956-997a-add3034ac5b8 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Refreshing network info cache for port 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:00 user nova-compute[72815]: INFO nova.compute.manager [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Terminating instance
Aug 17 20:02:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Successfully created port: 14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Successfully created port: 6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:02:01 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Instance destroyed successfully.
Aug 17 20:02:01 user nova-compute[72815]: DEBUG nova.objects.instance [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lazy-loading 'resources' on Instance uuid 541f3b1c-207c-4398-ad60-ea50e89d7327 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T19:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1165123793',display_name='tempest-TestShelveInstance-server-1165123793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1165123793',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOi2xPAwcqfdBW30FDVnS7XjBIbIL9ATRk8TVn3fOxiyLSk4/uTwVf9Ch/4yM8vaqqysPYH5jrDs4Bynmf17N9AcOBKLdweEqV6EFE5jypDJSnnZUP0g2Tlwbgatsxlpw==',key_name='tempest-TestShelveInstance-1359395454',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:00:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e0a431d27ae4571bc0c8687e61c6fa2',ramdisk_id='',reservation_id='r-rvvq1591',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1622767385',owner_user_name='tempest-TestShelveInstance-1622767385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:00:30Z,user_data=None,user_id='ce9def2151a447a68337ee04072fb748',uuid=541f3b1c-207c-4398-ad60-ea50e89d7327,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Converting VIF {"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_vif [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dfd3fe6-63, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:02:01 user nova-compute[72815]: INFO os_vif [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:78,bridge_name='br-int',has_traffic_filtering=True,id=9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e,network=Network(5f617030-c39b-44b4-a017-c667e18b4d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfd3fe6-63')
Aug 17 20:02:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQLHDUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:02:01 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-c194721f-cb74-4903-8147-6a4d6c8eb2e0 req-8d8402eb-fa59-48f3-ab1d-a191432394e2 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-vif-unplugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c194721f-cb74-4903-8147-6a4d6c8eb2e0 req-8d8402eb-fa59-48f3-ab1d-a191432394e2 service nova] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c194721f-cb74-4903-8147-6a4d6c8eb2e0 req-8d8402eb-fa59-48f3-ab1d-a191432394e2 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c194721f-cb74-4903-8147-6a4d6c8eb2e0 req-8d8402eb-fa59-48f3-ab1d-a191432394e2 service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-c194721f-cb74-4903-8147-6a4d6c8eb2e0 req-8d8402eb-fa59-48f3-ab1d-a191432394e2 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] No waiting events found dispatching network-vif-unplugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-c194721f-cb74-4903-8147-6a4d6c8eb2e0 req-8d8402eb-fa59-48f3-ab1d-a191432394e2 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-vif-unplugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[732b3501-6770-4a1c-b41c-2e774870d171]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bafd46a-396a-45c8-ae37-f42cc881590f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:01 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:02:01 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:02:01 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:01 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:01 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:02:01 user nova-compute[72815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 (non-flash)
Aug 17 20:02:01 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:01 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b41fa950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74'): ({'sdd'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Removing single pathed devices sdd {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2b907c-c3ed-43ef-8ce5-8200e50ca4d6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad20ab3-b141-432a-b8ca-3e6a48a4d376]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Flushing IO for device /dev/sdd {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e85dd9f-0d5e-4593-8793-715ea84f9374]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eacd88-2bad-46b1-960f-4e20638d3fcc]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_345a47f4', '/dev/disk/by-id/scsi-23938393032383333', '/dev/disk/by-id/scsi-1SCST_BIO345a47f4-98902833d33f5b1c') {{(pid=84269) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[866d78a9-287e-4a6b-a960-0ffffcfa8b65]: (4, None) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e7b715-7498-4dae-9c84-0a2617249967]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aef3827-a10f-4bf2-8c4f-afcc3e1b2285]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260]
Aug 17 20:02:02 user nova-compute[72815]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74, portal: 172.16.0.220,3260] successful.
Aug 17 20:02:02 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cbb8fea-e52b-47ef-a807-da463a755e74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd246c9-7361-4946-afb1-81803b40971e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] <== disconnect_volume: return (366ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:02:02 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Deleting instance files /opt/stack/data/nova/instances/541f3b1c-207c-4398-ad60-ea50e89d7327_del
Aug 17 20:02:02 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Deletion of /opt/stack/data/nova/instances/541f3b1c-207c-4398-ad60-ea50e89d7327_del complete
Aug 17 20:02:02 user nova-compute[72815]: INFO nova.compute.manager [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 17 20:02:02 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG nova.network.neutron [req-7cb55ed1-2784-43ec-9450-a859c375da9a req-d08a0796-54de-4956-997a-add3034ac5b8 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updated VIF entry in instance network info cache for port 9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG nova.network.neutron [req-7cb55ed1-2784-43ec-9450-a859c375da9a req-d08a0796-54de-4956-997a-add3034ac5b8 service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updating instance_info_cache with network_info: [{"id": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "address": "fa:16:3e:ef:8c:78", "network": {"id": "5f617030-c39b-44b4-a017-c667e18b4d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-67495461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e0a431d27ae4571bc0c8687e61c6fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfd3fe6-63", "ovs_interfaceid": "9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7cb55ed1-2784-43ec-9450-a859c375da9a req-d08a0796-54de-4956-997a-add3034ac5b8 service nova] Releasing lock "refresh_cache-541f3b1c-207c-4398-ad60-ea50e89d7327" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302507.5318365, 03a874db-ce51-4502-839d-7cf9ff2f9259 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:02:02 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] VM Stopped (Lifecycle Event)
Aug 17 20:02:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1e016151-a14e-4619-ab0c-ef67299deb78 None None] [instance: 03a874db-ce51-4502-839d-7cf9ff2f9259] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:02:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Successfully created port: e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:02:03 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:03 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Took 1.27 seconds to deallocate network for instance.
Aug 17 20:02:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-3caa88ca-4acf-418f-accf-f61a3c5fa01b req-4211f78d-6aa5-41d5-9c77-f25bdef70f2b service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3caa88ca-4acf-418f-accf-f61a3c5fa01b req-4211f78d-6aa5-41d5-9c77-f25bdef70f2b service nova] Acquiring lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3caa88ca-4acf-418f-accf-f61a3c5fa01b req-4211f78d-6aa5-41d5-9c77-f25bdef70f2b service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3caa88ca-4acf-418f-accf-f61a3c5fa01b req-4211f78d-6aa5-41d5-9c77-f25bdef70f2b service nova] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-3caa88ca-4acf-418f-accf-f61a3c5fa01b req-4211f78d-6aa5-41d5-9c77-f25bdef70f2b service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] No waiting events found dispatching network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:03 user nova-compute[72815]: WARNING nova.compute.manager [req-3caa88ca-4acf-418f-accf-f61a3c5fa01b req-4211f78d-6aa5-41d5-9c77-f25bdef70f2b service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received unexpected event network-vif-plugged-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e for instance with vm_state active and task_state deleting.
Aug 17 20:02:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-3caa88ca-4acf-418f-accf-f61a3c5fa01b req-4211f78d-6aa5-41d5-9c77-f25bdef70f2b service nova] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Received event network-vif-deleted-9dfd3fe6-6320-4f2d-b5e4-b71cd8fc771e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Successfully updated port: 81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-74f18534-538e-4fa2-a2e2-d28cca471ddf req-a2a37329-3111-4dbc-b1b9-5dc5b2a1fe11 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-changed-81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-74f18534-538e-4fa2-a2e2-d28cca471ddf req-a2a37329-3111-4dbc-b1b9-5dc5b2a1fe11 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing instance network info cache due to event network-changed-81faaa84-44af-45f7-bca9-0bf1dfd299de. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-74f18534-538e-4fa2-a2e2-d28cca471ddf req-a2a37329-3111-4dbc-b1b9-5dc5b2a1fe11 service nova] Acquiring lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-74f18534-538e-4fa2-a2e2-d28cca471ddf req-a2a37329-3111-4dbc-b1b9-5dc5b2a1fe11 service nova] Acquired lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG nova.network.neutron [req-74f18534-538e-4fa2-a2e2-d28cca471ddf req-a2a37329-3111-4dbc-b1b9-5dc5b2a1fe11 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing network info cache for port 81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG nova.network.neutron [req-74f18534-538e-4fa2-a2e2-d28cca471ddf req-a2a37329-3111-4dbc-b1b9-5dc5b2a1fe11 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG nova.network.neutron [req-74f18534-538e-4fa2-a2e2-d28cca471ddf req-a2a37329-3111-4dbc-b1b9-5dc5b2a1fe11 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-74f18534-538e-4fa2-a2e2-d28cca471ddf req-a2a37329-3111-4dbc-b1b9-5dc5b2a1fe11 service nova] Releasing lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:04 user nova-compute[72815]: INFO nova.compute.manager [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Took 0.99 seconds to detach 1 volumes for instance.
Aug 17 20:02:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Deleting volume: 8cbb8fea-e52b-47ef-a807-da463a755e74 {{(pid=72815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "12a34846-1670-4c6c-ac7d-522530aaf3a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:02:04 user nova-compute[72815]: INFO nova.compute.claims [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Claim successful on node user
Aug 17 20:02:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.696s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.684s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:02:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:02:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:02:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Creating image(s)
Aug 17 20:02:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "/opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "/opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "/opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Successfully updated port: 24d97c14-9767-4d76-a34c-b8e5d4585592 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.270s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.709s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-1385fe7c-1b36-422b-9bf1-da7f6c016881 req-b5778002-2542-4b5f-9b2d-82858d6fe84c service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-changed-24d97c14-9767-4d76-a34c-b8e5d4585592 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-1385fe7c-1b36-422b-9bf1-da7f6c016881 req-b5778002-2542-4b5f-9b2d-82858d6fe84c service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing instance network info cache due to event network-changed-24d97c14-9767-4d76-a34c-b8e5d4585592. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1385fe7c-1b36-422b-9bf1-da7f6c016881 req-b5778002-2542-4b5f-9b2d-82858d6fe84c service nova] Acquiring lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1385fe7c-1b36-422b-9bf1-da7f6c016881 req-b5778002-2542-4b5f-9b2d-82858d6fe84c service nova] Acquired lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.network.neutron [req-1385fe7c-1b36-422b-9bf1-da7f6c016881 req-b5778002-2542-4b5f-9b2d-82858d6fe84c service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing network info cache for port 24d97c14-9767-4d76-a34c-b8e5d4585592 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:02:06 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Deleted allocations for instance 541f3b1c-207c-4398-ad60-ea50e89d7327
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.226s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk 1073741824" returned: 0 in 0.092s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5a7f6b58-d481-4813-8689-16bbe19fac69 tempest-TestShelveInstance-1622767385 tempest-TestShelveInstance-1622767385-project-member] Lock "541f3b1c-207c-4398-ad60-ea50e89d7327" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.493s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.network.neutron [req-1385fe7c-1b36-422b-9bf1-da7f6c016881 req-b5778002-2542-4b5f-9b2d-82858d6fe84c service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.policy [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '169121564e514d4f883b71abeb3e6070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c20bd5232b4b058abc1b50f38cade3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.277s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Cannot resize image /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'migration_context' on Instance uuid 12a34846-1670-4c6c-ac7d-522530aaf3a7 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Ensure instance console log exists: /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG nova.network.neutron [req-1385fe7c-1b36-422b-9bf1-da7f6c016881 req-b5778002-2542-4b5f-9b2d-82858d6fe84c service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1385fe7c-1b36-422b-9bf1-da7f6c016881 req-b5778002-2542-4b5f-9b2d-82858d6fe84c service nova] Releasing lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Successfully updated port: a8299182-2e48-4a58-83a4-1e546caaeeae {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:02:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Successfully created port: 98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-c04be1e7-254d-4b60-86b6-4d7cc2bdeb7f req-baa0131f-3036-42ef-840b-67310882c9bc service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-changed-a8299182-2e48-4a58-83a4-1e546caaeeae {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-c04be1e7-254d-4b60-86b6-4d7cc2bdeb7f req-baa0131f-3036-42ef-840b-67310882c9bc service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing instance network info cache due to event network-changed-a8299182-2e48-4a58-83a4-1e546caaeeae. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c04be1e7-254d-4b60-86b6-4d7cc2bdeb7f req-baa0131f-3036-42ef-840b-67310882c9bc service nova] Acquiring lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c04be1e7-254d-4b60-86b6-4d7cc2bdeb7f req-baa0131f-3036-42ef-840b-67310882c9bc service nova] Acquired lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-c04be1e7-254d-4b60-86b6-4d7cc2bdeb7f req-baa0131f-3036-42ef-840b-67310882c9bc service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing network info cache for port a8299182-2e48-4a58-83a4-1e546caaeeae {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-c04be1e7-254d-4b60-86b6-4d7cc2bdeb7f req-baa0131f-3036-42ef-840b-67310882c9bc service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Successfully updated port: 72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Successfully updated port: 98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "refresh_cache-12a34846-1670-4c6c-ac7d-522530aaf3a7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquired lock "refresh_cache-12a34846-1670-4c6c-ac7d-522530aaf3a7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-2881f977-ea5e-4a78-942a-26b7932904c5 req-63e1a7f6-a17c-4455-bf05-4f591c10e9c3 service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Received event network-changed-98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-2881f977-ea5e-4a78-942a-26b7932904c5 req-63e1a7f6-a17c-4455-bf05-4f591c10e9c3 service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Refreshing instance network info cache due to event network-changed-98f41342-7493-4985-8f61-152b56913ed4. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2881f977-ea5e-4a78-942a-26b7932904c5 req-63e1a7f6-a17c-4455-bf05-4f591c10e9c3 service nova] Acquiring lock "refresh_cache-12a34846-1670-4c6c-ac7d-522530aaf3a7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-c04be1e7-254d-4b60-86b6-4d7cc2bdeb7f req-baa0131f-3036-42ef-840b-67310882c9bc service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:02:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c04be1e7-254d-4b60-86b6-4d7cc2bdeb7f req-baa0131f-3036-42ef-840b-67310882c9bc service nova] Releasing lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Updating instance_info_cache with network_info: [{"id": "98f41342-7493-4985-8f61-152b56913ed4", "address": "fa:16:3e:cd:16:2d", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f41342-74", "ovs_interfaceid": "98f41342-7493-4985-8f61-152b56913ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Releasing lock "refresh_cache-12a34846-1670-4c6c-ac7d-522530aaf3a7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Instance network_info: |[{"id": "98f41342-7493-4985-8f61-152b56913ed4", "address": "fa:16:3e:cd:16:2d", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f41342-74", "ovs_interfaceid": "98f41342-7493-4985-8f61-152b56913ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2881f977-ea5e-4a78-942a-26b7932904c5 req-63e1a7f6-a17c-4455-bf05-4f591c10e9c3 service nova] Acquired lock "refresh_cache-12a34846-1670-4c6c-ac7d-522530aaf3a7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.network.neutron [req-2881f977-ea5e-4a78-942a-26b7932904c5 req-63e1a7f6-a17c-4455-bf05-4f591c10e9c3 service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Refreshing network info cache for port 98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Start _get_guest_xml network_info=[{"id": "98f41342-7493-4985-8f61-152b56913ed4", "address": "fa:16:3e:cd:16:2d", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f41342-74", "ovs_interfaceid": "98f41342-7493-4985-8f61-152b56913ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:02:09 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:02:09 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-701913410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-701913410',id=24,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-ogwahb1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:02:06Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=12a34846-1670-4c6c-ac7d-522530aaf3a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98f41342-7493-4985-8f61-152b56913ed4", "address": "fa:16:3e:cd:16:2d", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f41342-74", "ovs_interfaceid": "98f41342-7493-4985-8f61-152b56913ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "98f41342-7493-4985-8f61-152b56913ed4", "address": "fa:16:3e:cd:16:2d", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f41342-74", "ovs_interfaceid": "98f41342-7493-4985-8f61-152b56913ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=98f41342-7493-4985-8f61-152b56913ed4,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f41342-74') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'pci_devices' on Instance uuid 12a34846-1670-4c6c-ac7d-522530aaf3a7 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:02:09 user nova-compute[72815]:   <uuid>12a34846-1670-4c6c-ac7d-522530aaf3a7</uuid>
Aug 17 20:02:09 user nova-compute[72815]:   <name>instance-00000018</name>
Aug 17 20:02:09 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:02:09 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:02:09 user nova-compute[72815]:   <metadata>
Aug 17 20:02:09 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:02:09 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:02:09 user nova-compute[72815]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-701913410</nova:name>
Aug 17 20:02:09 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:02:09</nova:creationTime>
Aug 17 20:02:09 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:02:09 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:02:09 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:02:09 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:02:09 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:02:09 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:02:09 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:02:09 user nova-compute[72815]:       <nova:owner>
Aug 17 20:02:09 user nova-compute[72815]:         <nova:user uuid="169121564e514d4f883b71abeb3e6070">tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member</nova:user>
Aug 17 20:02:09 user nova-compute[72815]:         <nova:project uuid="89c20bd5232b4b058abc1b50f38cade3">tempest-ServerBootFromVolumeStableRescueTest-264619992</nova:project>
Aug 17 20:02:09 user nova-compute[72815]:       </nova:owner>
Aug 17 20:02:09 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:02:09 user nova-compute[72815]:       <nova:ports>
Aug 17 20:02:09 user nova-compute[72815]:         <nova:port uuid="98f41342-7493-4985-8f61-152b56913ed4">
Aug 17 20:02:09 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 20:02:09 user nova-compute[72815]:         </nova:port>
Aug 17 20:02:09 user nova-compute[72815]:       </nova:ports>
Aug 17 20:02:09 user nova-compute[72815]:     </nova:instance>
Aug 17 20:02:09 user nova-compute[72815]:   </metadata>
Aug 17 20:02:09 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:02:09 user nova-compute[72815]:     <system>
Aug 17 20:02:09 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:02:09 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:02:09 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:02:09 user nova-compute[72815]:       <entry name="serial">12a34846-1670-4c6c-ac7d-522530aaf3a7</entry>
Aug 17 20:02:09 user nova-compute[72815]:       <entry name="uuid">12a34846-1670-4c6c-ac7d-522530aaf3a7</entry>
Aug 17 20:02:09 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:02:09 user nova-compute[72815]:     </system>
Aug 17 20:02:09 user nova-compute[72815]:   </sysinfo>
Aug 17 20:02:09 user nova-compute[72815]:   <os>
Aug 17 20:02:09 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:02:09 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:02:09 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:02:09 user nova-compute[72815]:   </os>
Aug 17 20:02:09 user nova-compute[72815]:   <features>
Aug 17 20:02:09 user nova-compute[72815]:     <acpi/>
Aug 17 20:02:09 user nova-compute[72815]:     <apic/>
Aug 17 20:02:09 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:02:09 user nova-compute[72815]:   </features>
Aug 17 20:02:09 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:02:09 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:02:09 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:02:09 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:02:09 user nova-compute[72815]:   </clock>
Aug 17 20:02:09 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:02:09 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:02:09 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:02:09 user nova-compute[72815]:   </cpu>
Aug 17 20:02:09 user nova-compute[72815]:   <devices>
Aug 17 20:02:09 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:02:09 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:02:09 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk"/>
Aug 17 20:02:09 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:02:09 user nova-compute[72815]:     </disk>
Aug 17 20:02:09 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:02:09 user nova-compute[72815]:       <mac address="fa:16:3e:cd:16:2d"/>
Aug 17 20:02:09 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:02:09 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:02:09 user nova-compute[72815]:       <target dev="tap98f41342-74"/>
Aug 17 20:02:09 user nova-compute[72815]:     </interface>
Aug 17 20:02:09 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:02:09 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/console.log" append="off"/>
Aug 17 20:02:09 user nova-compute[72815]:     </serial>
Aug 17 20:02:09 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:02:09 user nova-compute[72815]:     <video>
Aug 17 20:02:09 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:02:09 user nova-compute[72815]:     </video>
Aug 17 20:02:09 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:02:09 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:02:09 user nova-compute[72815]:     </rng>
Aug 17 20:02:09 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:02:09 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:02:09 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:02:09 user nova-compute[72815]:     </memballoon>
Aug 17 20:02:09 user nova-compute[72815]:   </devices>
Aug 17 20:02:09 user nova-compute[72815]: </domain>
Aug 17 20:02:09 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-701913410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-701913410',id=24,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-ogwahb1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:02:06Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=12a34846-1670-4c6c-ac7d-522530aaf3a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98f41342-7493-4985-8f61-152b56913ed4", "address": "fa:16:3e:cd:16:2d", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f41342-74", "ovs_interfaceid": "98f41342-7493-4985-8f61-152b56913ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "98f41342-7493-4985-8f61-152b56913ed4", "address": "fa:16:3e:cd:16:2d", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f41342-74", "ovs_interfaceid": "98f41342-7493-4985-8f61-152b56913ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=98f41342-7493-4985-8f61-152b56913ed4,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f41342-74') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG os_vif [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=98f41342-7493-4985-8f61-152b56913ed4,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f41342-74') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98f41342-74, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98f41342-74, col_values=(('external_ids', {'iface-id': '98f41342-7493-4985-8f61-152b56913ed4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:16:2d', 'vm-uuid': '12a34846-1670-4c6c-ac7d-522530aaf3a7'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:09 user nova-compute[72815]: INFO os_vif [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=98f41342-7493-4985-8f61-152b56913ed4,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f41342-74')
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Successfully updated port: 14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No VIF found with MAC fa:16:3e:cd:16:2d, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.network.neutron [req-2881f977-ea5e-4a78-942a-26b7932904c5 req-63e1a7f6-a17c-4455-bf05-4f591c10e9c3 service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Updated VIF entry in instance network info cache for port 98f41342-7493-4985-8f61-152b56913ed4. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG nova.network.neutron [req-2881f977-ea5e-4a78-942a-26b7932904c5 req-63e1a7f6-a17c-4455-bf05-4f591c10e9c3 service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Updating instance_info_cache with network_info: [{"id": "98f41342-7493-4985-8f61-152b56913ed4", "address": "fa:16:3e:cd:16:2d", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f41342-74", "ovs_interfaceid": "98f41342-7493-4985-8f61-152b56913ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2881f977-ea5e-4a78-942a-26b7932904c5 req-63e1a7f6-a17c-4455-bf05-4f591c10e9c3 service nova] Releasing lock "refresh_cache-12a34846-1670-4c6c-ac7d-522530aaf3a7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Successfully updated port: 6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-changed-72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing instance network info cache due to event network-changed-72a288ef-76e2-4e98-bb56-8b0d9f28f078. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] Acquiring lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] Acquired lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing network info cache for port 72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] Releasing lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-changed-14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing instance network info cache due to event network-changed-14643db7-4fda-41a1-b528-a11fc8dfca07. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] Acquiring lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] Acquired lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing network info cache for port 14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG nova.network.neutron [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Successfully updated port: e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] Releasing lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-changed-6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing instance network info cache due to event network-changed-6ba0398c-a9e2-4608-aa03-f8baed9efa56. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] Acquiring lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] Acquired lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG nova.network.neutron [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing network info cache for port 6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-dcc29955-f60e-462d-9059-ad6efc4c24ac req-ad8c280e-ab93-46bc-881f-008fe3f43ebf service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Received event network-vif-plugged-98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dcc29955-f60e-462d-9059-ad6efc4c24ac req-ad8c280e-ab93-46bc-881f-008fe3f43ebf service nova] Acquiring lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dcc29955-f60e-462d-9059-ad6efc4c24ac req-ad8c280e-ab93-46bc-881f-008fe3f43ebf service nova] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dcc29955-f60e-462d-9059-ad6efc4c24ac req-ad8c280e-ab93-46bc-881f-008fe3f43ebf service nova] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-dcc29955-f60e-462d-9059-ad6efc4c24ac req-ad8c280e-ab93-46bc-881f-008fe3f43ebf service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] No waiting events found dispatching network-vif-plugged-98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:11 user nova-compute[72815]: WARNING nova.compute.manager [req-dcc29955-f60e-462d-9059-ad6efc4c24ac req-ad8c280e-ab93-46bc-881f-008fe3f43ebf service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Received unexpected event network-vif-plugged-98f41342-7493-4985-8f61-152b56913ed4 for instance with vm_state building and task_state spawning.
Aug 17 20:02:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG nova.network.neutron [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG nova.network.neutron [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-78c641aa-4747-4d7d-a8ca-095a78124d43 req-594440b8-0ce1-4286-9f82-09c228e44b32 service nova] Releasing lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquired lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:02:11 user nova-compute[72815]: INFO nova.virt.block_device [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Booting with volume 704aec49-8456-46f7-8d02-b0b837bb7e49 at /dev/vdb
Aug 17 20:02:11 user nova-compute[72815]: DEBUG os_brick.utils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5b1e2b-3b8a-4fae-8a9c-9a1b6d408dbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda55444-4dc1-47b9-ab02-4d592e31c4b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00c8c62-b5bb-4e7a-a822-091b1967bd24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[176bb1a4-c76d-42c2-ad90-d83e03fa3e5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:02:12 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:02:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb50cda-da33-46d8-a184-59f9c4a5315d]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG os_brick.utils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating existing volume attachment record: 9ad953ba-2e6f-417d-a462-a8306702e7e0 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-ca3d9e8f-7ca9-46a7-bae2-b6b4a253dd7a req-6738249b-b48c-4f15-bbdc-bdba572d2f31 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-changed-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-ca3d9e8f-7ca9-46a7-bae2-b6b4a253dd7a req-6738249b-b48c-4f15-bbdc-bdba572d2f31 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing instance network info cache due to event network-changed-e7a8e140-3c2b-4a89-af4b-4ccc271357e1. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:02:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ca3d9e8f-7ca9-46a7-bae2-b6b4a253dd7a req-6738249b-b48c-4f15-bbdc-bdba572d2f31 service nova] Acquiring lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302533.05884, 12a34846-1670-4c6c-ac7d-522530aaf3a7 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:02:13 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] VM Resumed (Lifecycle Event)
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:02:13 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Instance spawned successfully.
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:02:13 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302533.0602546, 12a34846-1670-4c6c-ac7d-522530aaf3a7 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:02:13 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] VM Started (Lifecycle Event)
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:02:13 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-11c78175-0b99-444a-b019-7c35a9040627 req-dc416be1-8d44-4984-89d5-aa071ade9c62 service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Received event network-vif-plugged-98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-11c78175-0b99-444a-b019-7c35a9040627 req-dc416be1-8d44-4984-89d5-aa071ade9c62 service nova] Acquiring lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-11c78175-0b99-444a-b019-7c35a9040627 req-dc416be1-8d44-4984-89d5-aa071ade9c62 service nova] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-11c78175-0b99-444a-b019-7c35a9040627 req-dc416be1-8d44-4984-89d5-aa071ade9c62 service nova] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-11c78175-0b99-444a-b019-7c35a9040627 req-dc416be1-8d44-4984-89d5-aa071ade9c62 service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] No waiting events found dispatching network-vif-plugged-98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:13 user nova-compute[72815]: WARNING nova.compute.manager [req-11c78175-0b99-444a-b019-7c35a9040627 req-dc416be1-8d44-4984-89d5-aa071ade9c62 service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Received unexpected event network-vif-plugged-98f41342-7493-4985-8f61-152b56913ed4 for instance with vm_state building and task_state spawning.
Aug 17 20:02:13 user nova-compute[72815]: INFO nova.compute.manager [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Took 7.53 seconds to spawn the instance on the hypervisor.
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:02:13 user nova-compute[72815]: INFO nova.compute.manager [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Took 8.65 seconds to build instance.
Aug 17 20:02:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6d7fe0c6-72ee-4731-8a92-60c0c1ce465a tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.747s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [{"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "address": "fa:16:3e:aa:e9:9e", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba0398c-a9", "ovs_interfaceid": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "address": "fa:16:3e:f6:10:47", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a8e140-3c", "ovs_interfaceid": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Releasing lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Instance network_info: |[{"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "address": "fa:16:3e:aa:e9:9e", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba0398c-a9", "ovs_interfaceid": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "address": "fa:16:3e:f6:10:47", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a8e140-3c", "ovs_interfaceid": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ca3d9e8f-7ca9-46a7-bae2-b6b4a253dd7a req-6738249b-b48c-4f15-bbdc-bdba572d2f31 service nova] Acquired lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-ca3d9e8f-7ca9-46a7-bae2-b6b4a253dd7a req-6738249b-b48c-4f15-bbdc-bdba572d2f31 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing network info cache for port e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:02:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:14 user nova-compute[72815]: DEBUG nova.network.neutron [req-ca3d9e8f-7ca9-46a7-bae2-b6b4a253dd7a req-6738249b-b48c-4f15-bbdc-bdba572d2f31 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updated VIF entry in instance network info cache for port e7a8e140-3c2b-4a89-af4b-4ccc271357e1. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:02:14 user nova-compute[72815]: DEBUG nova.network.neutron [req-ca3d9e8f-7ca9-46a7-bae2-b6b4a253dd7a req-6738249b-b48c-4f15-bbdc-bdba572d2f31 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [{"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "address": "fa:16:3e:aa:e9:9e", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba0398c-a9", "ovs_interfaceid": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "address": "fa:16:3e:f6:10:47", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a8e140-3c", "ovs_interfaceid": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ca3d9e8f-7ca9-46a7-bae2-b6b4a253dd7a req-6738249b-b48c-4f15-bbdc-bdba572d2f31 service nova] Releasing lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:16 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302521.6528208, 541f3b1c-207c-4398-ad60-ea50e89d7327 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:02:16 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] VM Stopped (Lifecycle Event)
Aug 17 20:02:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-10f8f249-1f3e-4325-85b0-766cc16f74fb None None] [instance: 541f3b1c-207c-4398-ad60-ea50e89d7327] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:02:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:24 user nova-compute[72815]: INFO nova.compute.manager [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Detaching volume c500c537-a5a5-45c9-9d49-de565adcbbf0
Aug 17 20:02:24 user nova-compute[72815]: INFO nova.virt.block_device [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Attempting to driver detach volume c500c537-a5a5-45c9-9d49-de565adcbbf0 from mountpoint /dev/vdb
Aug 17 20:02:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Attempting to detach device vdb from instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:02:24 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:02:24 user nova-compute[72815]:   <source dev="/dev/sdg"/>
Aug 17 20:02:24 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:02:24 user nova-compute[72815]:   <serial>c500c537-a5a5-45c9-9d49-de565adcbbf0</serial>
Aug 17 20:02:24 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 20:02:24 user nova-compute[72815]: </disk>
Aug 17 20:02:24 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:02:24 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully detached device vdb from instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 from the persistent domain config.
Aug 17 20:02:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:02:24 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:02:24 user nova-compute[72815]:   <source dev="/dev/sdg"/>
Aug 17 20:02:24 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:02:24 user nova-compute[72815]:   <serial>c500c537-a5a5-45c9-9d49-de565adcbbf0</serial>
Aug 17 20:02:24 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 20:02:24 user nova-compute[72815]: </disk>
Aug 17 20:02:24 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:02:24 user nova-compute[72815]: INFO nova.virt.block_device [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Booting with volume 57fa4a25-c0db-4be9-bc59-0813a0ead570 at /dev/vdc
Aug 17 20:02:24 user nova-compute[72815]: DEBUG os_brick.utils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302544.9253154, fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9d49ae-bde7-4e4d-b1e3-615bd632489b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:24 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully detached device vdb from instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 from the live domain config.
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRdiENpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:02:24 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:02:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad2c096-f744-4305-a2bb-183f33255b32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[184bd5bc-9d06-45a2-9ce2-cfe7f33feb58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[49acc86d-1336-4f05-b112-d6cdffea0299]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cbb683-cec4-4782-bf6f-6e56a7fa3d5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05cbd9e-fe23-4ad6-8560-ad1903335ca2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:25 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:02:25 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:25 user nova-compute[72815]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 (non-flash)
Aug 17 20:02:25 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994486b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0'): ({'sdg'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Removing single pathed devices sdg {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:25 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f080b0b-c3f4-4c71-8f22-8b11a43f3c52]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.utils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating existing volume attachment record: 2a353908-b414-40c1-bd72-ddba285b315b {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2089e8f-b3a4-4db0-af24-efdb784cf464]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ab682-bada-4c44-bcc9-3f803d7542c5]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flushing IO for device /dev/sdg {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9228f1-1c95-4735-91b9-3f615d8d4e25]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c7d931-faef-4696-8278-806e48f363ff]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] SCSI volumes sdg have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1ee289-a25a-41c8-b3b0-c5ddee63f0e6]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5e29a3-faa8-4ff2-99b2-ead1738bcedb]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260]
Aug 17 20:02:25 user nova-compute[72815]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0, portal: 172.16.0.220,3260] successful.
Aug 17 20:02:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c500c537-a5a5-45c9-9d49-de565adcbbf0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89d436a-840f-43ce-aa6b-5c49cdd6df5b]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== disconnect_volume: return (364ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:02:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:02:26 user nova-compute[72815]: DEBUG nova.objects.instance [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'flavor' on Instance uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8b1f8879-ae30-4fb6-bdb8-5f82b6220dab tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.917s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:27 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:02:27 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:02:28 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:02:28 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:02:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:28 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:29 user nova-compute[72815]: INFO nova.compute.manager [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Unshelving
Aug 17 20:02:29 user nova-compute[72815]: INFO nova.virt.block_device [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Booting with volume a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb at /dev/vdc
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG os_brick.utils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7e24e7-5986-4696-9b40-2e91fdee2075]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d314e64-57dd-4a4a-b197-51a4c927fa9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3740fee-eaf5-4c8b-aefa-37f59afc1d78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[93921190-1e75-44ce-8e77-a428903a9387]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:02:29 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cd95d3-9281-4851-b3fb-910ef92f8182]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG os_brick.utils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updating existing volume attachment record: 7ce2d11b-0a05-4f74-baa8-4cac45def8ce {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:02:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-46182df9-9ca0-4e86-a643-d49417f0348c req-618172af-2693-4ba9-8a39-3ebb99f4c7b8 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Received event network-changed-419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-46182df9-9ca0-4e86-a643-d49417f0348c req-618172af-2693-4ba9-8a39-3ebb99f4c7b8 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Refreshing instance network info cache due to event network-changed-419cc7ce-bdbb-4add-81ff-e40402e5997d. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-46182df9-9ca0-4e86-a643-d49417f0348c req-618172af-2693-4ba9-8a39-3ebb99f4c7b8 service nova] Acquiring lock "refresh_cache-a5f4e2b3-6d84-418d-9109-07a4362b4d7b" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-46182df9-9ca0-4e86-a643-d49417f0348c req-618172af-2693-4ba9-8a39-3ebb99f4c7b8 service nova] Acquired lock "refresh_cache-a5f4e2b3-6d84-418d-9109-07a4362b4d7b" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG nova.network.neutron [req-46182df9-9ca0-4e86-a643-d49417f0348c req-618172af-2693-4ba9-8a39-3ebb99f4c7b8 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Refreshing network info cache for port 419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:33 user nova-compute[72815]: INFO nova.compute.manager [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Terminating instance
Aug 17 20:02:33 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-9b7518b2-67da-425f-8a6d-f5f0f0540ebf req-e6dad5d3-0247-4809-8867-26f290f5d8e2 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Received event network-vif-unplugged-419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9b7518b2-67da-425f-8a6d-f5f0f0540ebf req-e6dad5d3-0247-4809-8867-26f290f5d8e2 service nova] Acquiring lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9b7518b2-67da-425f-8a6d-f5f0f0540ebf req-e6dad5d3-0247-4809-8867-26f290f5d8e2 service nova] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9b7518b2-67da-425f-8a6d-f5f0f0540ebf req-e6dad5d3-0247-4809-8867-26f290f5d8e2 service nova] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-9b7518b2-67da-425f-8a6d-f5f0f0540ebf req-e6dad5d3-0247-4809-8867-26f290f5d8e2 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] No waiting events found dispatching network-vif-unplugged-419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-9b7518b2-67da-425f-8a6d-f5f0f0540ebf req-e6dad5d3-0247-4809-8867-26f290f5d8e2 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Received event network-vif-unplugged-419cc7ce-bdbb-4add-81ff-e40402e5997d for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.network.neutron [req-46182df9-9ca0-4e86-a643-d49417f0348c req-618172af-2693-4ba9-8a39-3ebb99f4c7b8 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Updated VIF entry in instance network info cache for port 419cc7ce-bdbb-4add-81ff-e40402e5997d. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.network.neutron [req-46182df9-9ca0-4e86-a643-d49417f0348c req-618172af-2693-4ba9-8a39-3ebb99f4c7b8 service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Updating instance_info_cache with network_info: [{"id": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "address": "fa:16:3e:ed:51:37", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419cc7ce-bd", "ovs_interfaceid": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-46182df9-9ca0-4e86-a643-d49417f0348c req-618172af-2693-4ba9-8a39-3ebb99f4c7b8 service nova] Releasing lock "refresh_cache-a5f4e2b3-6d84-418d-9109-07a4362b4d7b" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:34 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Instance destroyed successfully.
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lazy-loading 'resources' on Instance uuid a5f4e2b3-6d84-418d-9109-07a4362b4d7b {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-286806879',display_name='tempest-TestStampPattern-server-286806879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-286806879',id=21,image_ref='3f8293f6-06fa-4f58-a508-fa1c7a2ee0d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqC6RUkKN1taHh2Rn8c1allkbJ0/yuwdo3QXAdudNtPlH8PHi5tBUQIsWAsylFF7ZKs0Ps3Kru7ooqRhdzKKP021tMxib7YsWN4dc0onmkUhJNvpAEEo06cjY/saqY+9Q==',key_name='tempest-TestStampPattern-190535839',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:59:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dddf9ff8534e4c1c8afc48c9d02fefcb',ramdisk_id='',reservation_id='r-2lszp9xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='45b6365f-333f-45f1-b619-3453cbe75a88',image_min_disk='1',image_min_ram='0',image_owner_id='dddf9ff8534e4c1c8afc48c9d02fefcb',image_owner_project_name='tempest-TestStampPattern-1204244634',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1204244634-project-member',image_user_id='190c2e4fdf3e49c3a760e332ab09baf3',owner_project_name='tempest-TestStampPattern-1204244634',owner_user_name='tempest-TestStampPattern-1204244634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:59:41Z,user_data=None,user_id='190c2e4fdf3e49c3a760e332ab09baf3',uuid=a5f4e2b3-6d84-418d-9109-07a4362b4d7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "address": "fa:16:3e:ed:51:37", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419cc7ce-bd", "ovs_interfaceid": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Converting VIF {"id": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "address": "fa:16:3e:ed:51:37", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419cc7ce-bd", "ovs_interfaceid": "419cc7ce-bdbb-4add-81ff-e40402e5997d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:51:37,bridge_name='br-int',has_traffic_filtering=True,id=419cc7ce-bdbb-4add-81ff-e40402e5997d,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419cc7ce-bd') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG os_vif [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:51:37,bridge_name='br-int',has_traffic_filtering=True,id=419cc7ce-bdbb-4add-81ff-e40402e5997d,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419cc7ce-bd') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap419cc7ce-bd, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:34 user nova-compute[72815]: INFO os_vif [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:51:37,bridge_name='br-int',has_traffic_filtering=True,id=419cc7ce-bdbb-4add-81ff-e40402e5997d,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419cc7ce-bd')
Aug 17 20:02:34 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Deleting instance files /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b_del
Aug 17 20:02:34 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Deletion of /opt/stack/data/nova/instances/a5f4e2b3-6d84-418d-9109-07a4362b4d7b_del complete
Aug 17 20:02:34 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:02:34 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=6765MB free_disk=25.296485900878906GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:34 user nova-compute[72815]: INFO nova.compute.manager [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 17 20:02:34 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Applying migration context for instance 3a4f27f3-4573-43b5-827a-bbdae4ebce10 as it has an incoming, in-progress migration 7aa604a3-81e6-40fb-8398-85a8710bd4bd. Migration status is finished {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 20:02:34 user nova-compute[72815]: INFO nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating resource usage from migration 7aa604a3-81e6-40fb-8398-85a8710bd4bd
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 45b6365f-333f-45f1-b619-3453cbe75a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance a5f4e2b3-6d84-418d-9109-07a4362b4d7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Migration 7aa604a3-81e6-40fb-8398-85a8710bd4bd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 3a4f27f3-4573-43b5-827a-bbdae4ebce10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 71e8c292-6412-4079-8a2c-11c65c808588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance d45cf87c-d69c-4334-8638-0b92ae395e99 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 12a34846-1670-4c6c-ac7d-522530aaf3a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ee4a8248-9abc-45b3-9bf6-349c4d11f189 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:02:34 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.726s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:35 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Took 0.67 seconds to deallocate network for instance.
Aug 17 20:02:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-11e5948f-7fa1-4e08-86f3-35a7787358fb req-f40410c6-2a81-4201-9bbb-d243fdd047aa service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Received event network-vif-plugged-419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-11e5948f-7fa1-4e08-86f3-35a7787358fb req-f40410c6-2a81-4201-9bbb-d243fdd047aa service nova] Acquiring lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-11e5948f-7fa1-4e08-86f3-35a7787358fb req-f40410c6-2a81-4201-9bbb-d243fdd047aa service nova] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-11e5948f-7fa1-4e08-86f3-35a7787358fb req-f40410c6-2a81-4201-9bbb-d243fdd047aa service nova] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-11e5948f-7fa1-4e08-86f3-35a7787358fb req-f40410c6-2a81-4201-9bbb-d243fdd047aa service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] No waiting events found dispatching network-vif-plugged-419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:35 user nova-compute[72815]: WARNING nova.compute.manager [req-11e5948f-7fa1-4e08-86f3-35a7787358fb req-f40410c6-2a81-4201-9bbb-d243fdd047aa service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Received unexpected event network-vif-plugged-419cc7ce-bdbb-4add-81ff-e40402e5997d for instance with vm_state deleted and task_state None.
Aug 17 20:02:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-11e5948f-7fa1-4e08-86f3-35a7787358fb req-f40410c6-2a81-4201-9bbb-d243fdd047aa service nova] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Received event network-vif-deleted-419cc7ce-bdbb-4add-81ff-e40402e5997d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:02:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:35 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Deleted allocations for instance a5f4e2b3-6d84-418d-9109-07a4362b4d7b
Aug 17 20:02:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7ca00969-e237-4879-a703-6cbe1792eef8 tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "a5f4e2b3-6d84-418d-9109-07a4362b4d7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.807s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:02:37 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Creating image(s)
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Ensure instance console log exists: /opt/stack/data/nova/instances/d45cf87c-d69c-4334-8638-0b92ae395e99/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Start _get_guest_xml network_info=[{"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "address": "fa:16:3e:aa:e9:9e", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba0398c-a9", "ovs_interfaceid": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "address": "fa:16:3e:f6:10:47", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a8e140-3c", "ovs_interfaceid": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '1f2bbe0f-fd76-426d-b0d9-7d51d1c0c156', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYdDVWbo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd45cf87c-d69c-4334-8638-0b92ae395e99', 'attached_at': '', 'detached_at': '', 'volume_id': '14b4030a-a6cd-446d-8014-480d030fabb6', 'serial': '14b4030a-a6cd-446d-8014-480d030fabb6'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'attachment_id': '9ad953ba-2e6f-417d-a462-a8306702e7e0', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHeybAuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd45cf87c-d69c-4334-8638-0b92ae395e99', 'attached_at': '', 'detached_at': '', 'volume_id': '704aec49-8456-46f7-8d02-b0b837bb7e49', 'serial': '704aec49-8456-46f7-8d02-b0b837bb7e49'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'attachment_id': '2a353908-b414-40c1-bd72-ddba285b315b', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuUZchCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd45cf87c-d69c-4334-8638-0b92ae395e99', 'attached_at': '', 'detached_at': '', 'volume_id': '57fa4a25-c0db-4be9-bc59-0813a0ead570', 'serial': '57fa4a25-c0db-4be9-bc59-0813a0ead570'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:02:37 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:02:37 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYdDVWbo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:02:37 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:02:37 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:02:37 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[115341dd-6463-4a3c-a9ee-c588bd2d7108]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:02:37 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4e99b6-db09-4c62-8d40-e6f499224e3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6] added
Aug 17 20:02:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffbf311-469f-4fc3-bf62-0504f8ef0f19]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd1e294-3856-4736-8c86-2ced74ef9d85]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYdDVWbo {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYdDVWbo" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f0d34-1236-4b1e-bcd6-2b06cc3c302d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AYdDVWbo'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c7da31-3db5-4b15-be23-e30365718ffe]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9e398c-946c-4b7f-95ef-d40d4a470c38]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:37 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:37 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c88e25-c863-4734-ad40-3ae8b01425e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6, portal: 172.16.0.220,3260]
Aug 17 20:02:37 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6, portal: 172.16.0.220,3260] successful.
Aug 17 20:02:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f712179-4d88-4e68-a217-ed8448bc5f3e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfe7828-2d90-4908-a81a-1cabf17935d9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:37 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:37 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:37 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:37 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c90ac9-1288-4489-bce7-f521923fa011]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:02:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYdDVWbo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updating instance_info_cache with network_info: [{"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26339343763336365', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339343763336365', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHeybAuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:02:38 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:02:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:02:38 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:02:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:02:38 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9d9a76-d435-4687-9f12-594b3e2bb7b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:02:38 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0b652c-f791-4f8c-a1d6-ece2492f7ebc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49] added
Aug 17 20:02:38 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cd1dd0-56d0-402b-8730-9695fed428ea]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df968a5-c306-4439-9999-f9204705108b]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHeybAuP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHeybAuP" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b464c61c-b1b7-42b5-ba09-c3f9d68b5ee0]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EHeybAuP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fc42de-7206-467c-9f17-8af743ffc8db]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[97967255-ad53-455c-a6d7-280b31271ad3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:39 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:39 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:39 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:39 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:39 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:39 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc18dc0-76db-4fb1-8759-a773ac5eac31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49, portal: 172.16.0.220,3260]
Aug 17 20:02:39 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49, portal: 172.16.0.220,3260] successful.
Aug 17 20:02:39 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6c6b57-13d8-4c91-83c8-34bf691b5f56]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e076c263-0c39-4f8f-ae2b-2442dc544d9e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:39 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:39 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:39 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:02:39 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:39 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:39 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:39 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:02:39 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[04943a2f-93e7-4981-8df3-3b835a0f8583]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:02:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHeybAuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26238386364616338', 'path': '/dev/sdd'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238386364616338', 'path': '/dev/sdd'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuUZchCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:02:40 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:02:40 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:02:40 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[58044855-e8a6-4c38-91f6-b6edaf97a719]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:02:40 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1a476d-d5d3-4358-a267-4728804bc334]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570] added
Aug 17 20:02:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a710772-95bd-49c7-9199-9f5885c78bd3]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeb1b57-35ef-4c3d-82df-59930a4283ab]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XuUZchCd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XuUZchCd" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6eacf6-216e-4419-a645-581e3ba3964a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XuUZchCd'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd9cfef-9f9c-4e93-b2c9-1341dfb40e33]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[616072d6-d9ae-4c56-8bfd-add5838e215c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5e29ae-7d9a-4a48-902a-5aa82e44023c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570, portal: 172.16.0.220,3260]
Aug 17 20:02:40 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570, portal: 172.16.0.220,3260] successful.
Aug 17 20:02:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b255c5d4-6c50-4878-a78f-2d73d8d9f319]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0235bba4-6b91-40f0-a61a-3795a6ae425e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:02:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c489bdf-910b-4fa0-8c89-694776d38248]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuUZchCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23531353038623535', 'path': '/dev/sde'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531353038623535', 'path': '/dev/sde'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:7f:b5,bridge_name='br-int',has_traffic_filtering=True,id=81faaa84-44af-45f7-bca9-0bf1dfd299de,network=Network(fb515358-ed40-434f-9826-4d8b6a558fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81faaa84-44') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e9:97,bridge_name='br-int',has_traffic_filtering=True,id=24d97c14-9767-4d76-a34c-b8e5d4585592,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24d97c14-97') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:00:9e,bridge_name='br-int',has_traffic_filtering=True,id=a8299182-2e48-4a58-83a4-1e546caaeeae,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8299182-2e') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:59,bridge_name='br-int',has_traffic_filtering=True,id=72a288ef-76e2-4e98-bb56-8b0d9f28f078,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a288ef-76') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:93:94,bridge_name='br-int',has_traffic_filtering=True,id=14643db7-4fda-41a1-b528-a11fc8dfca07,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14643db7-4f') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "address": "fa:16:3e:aa:e9:9e", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba0398c-a9", "ovs_interfaceid": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "address": "fa:16:3e:aa:e9:9e", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba0398c-a9", "ovs_interfaceid": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e9:9e,bridge_name='br-int',has_traffic_filtering=True,id=6ba0398c-a9e2-4608-aa03-f8baed9efa56,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba0398c-a9') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "address": "fa:16:3e:f6:10:47", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a8e140-3c", "ovs_interfaceid": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "address": "fa:16:3e:f6:10:47", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a8e140-3c", "ovs_interfaceid": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:47,bridge_name='br-int',has_traffic_filtering=True,id=e7a8e140-3c2b-4a89-af4b-4ccc271357e1,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a8e140-3c') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lazy-loading 'pci_devices' on Instance uuid d45cf87c-d69c-4334-8638-0b92ae395e99 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:02:41 user nova-compute[72815]:   <uuid>d45cf87c-d69c-4334-8638-0b92ae395e99</uuid>
Aug 17 20:02:41 user nova-compute[72815]:   <name>instance-00000017</name>
Aug 17 20:02:41 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:02:41 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:02:41 user nova-compute[72815]:   <metadata>
Aug 17 20:02:41 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:02:41 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:02:41 user nova-compute[72815]:       <nova:name>tempest-device-tagging-server-449057570</nova:name>
Aug 17 20:02:41 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:02:37</nova:creationTime>
Aug 17 20:02:41 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:02:41 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:02:41 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:02:41 user nova-compute[72815]:       <nova:owner>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:user uuid="f2b94419b4fc41f7b5303c6f98a503fb">tempest-TaggedBootDevicesTest-1656341443-project-member</nova:user>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:project uuid="28eef397b2824b58bafe33616d7c48c9">tempest-TaggedBootDevicesTest-1656341443</nova:project>
Aug 17 20:02:41 user nova-compute[72815]:       </nova:owner>
Aug 17 20:02:41 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:02:41 user nova-compute[72815]:       <nova:ports>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:port uuid="81faaa84-44af-45f7-bca9-0bf1dfd299de">
Aug 17 20:02:41 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 20:02:41 user nova-compute[72815]:         </nova:port>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:port uuid="24d97c14-9767-4d76-a34c-b8e5d4585592">
Aug 17 20:02:41 user nova-compute[72815]:           <nova:ip type="fixed" address="10.1.1.217" ipVersion="4"/>
Aug 17 20:02:41 user nova-compute[72815]:         </nova:port>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:port uuid="a8299182-2e48-4a58-83a4-1e546caaeeae">
Aug 17 20:02:41 user nova-compute[72815]:           <nova:ip type="fixed" address="10.1.1.153" ipVersion="4"/>
Aug 17 20:02:41 user nova-compute[72815]:         </nova:port>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:port uuid="72a288ef-76e2-4e98-bb56-8b0d9f28f078">
Aug 17 20:02:41 user nova-compute[72815]:           <nova:ip type="fixed" address="10.1.1.249" ipVersion="4"/>
Aug 17 20:02:41 user nova-compute[72815]:         </nova:port>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:port uuid="14643db7-4fda-41a1-b528-a11fc8dfca07">
Aug 17 20:02:41 user nova-compute[72815]:           <nova:ip type="fixed" address="10.1.1.48" ipVersion="4"/>
Aug 17 20:02:41 user nova-compute[72815]:         </nova:port>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:port uuid="6ba0398c-a9e2-4608-aa03-f8baed9efa56">
Aug 17 20:02:41 user nova-compute[72815]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 20:02:41 user nova-compute[72815]:         </nova:port>
Aug 17 20:02:41 user nova-compute[72815]:         <nova:port uuid="e7a8e140-3c2b-4a89-af4b-4ccc271357e1">
Aug 17 20:02:41 user nova-compute[72815]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 20:02:41 user nova-compute[72815]:         </nova:port>
Aug 17 20:02:41 user nova-compute[72815]:       </nova:ports>
Aug 17 20:02:41 user nova-compute[72815]:     </nova:instance>
Aug 17 20:02:41 user nova-compute[72815]:   </metadata>
Aug 17 20:02:41 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:02:41 user nova-compute[72815]:     <system>
Aug 17 20:02:41 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:02:41 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:02:41 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:02:41 user nova-compute[72815]:       <entry name="serial">d45cf87c-d69c-4334-8638-0b92ae395e99</entry>
Aug 17 20:02:41 user nova-compute[72815]:       <entry name="uuid">d45cf87c-d69c-4334-8638-0b92ae395e99</entry>
Aug 17 20:02:41 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:02:41 user nova-compute[72815]:     </system>
Aug 17 20:02:41 user nova-compute[72815]:   </sysinfo>
Aug 17 20:02:41 user nova-compute[72815]:   <os>
Aug 17 20:02:41 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:02:41 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:02:41 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:02:41 user nova-compute[72815]:   </os>
Aug 17 20:02:41 user nova-compute[72815]:   <features>
Aug 17 20:02:41 user nova-compute[72815]:     <acpi/>
Aug 17 20:02:41 user nova-compute[72815]:     <apic/>
Aug 17 20:02:41 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:02:41 user nova-compute[72815]:   </features>
Aug 17 20:02:41 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:02:41 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:02:41 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:02:41 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:02:41 user nova-compute[72815]:   </clock>
Aug 17 20:02:41 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:02:41 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:02:41 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:02:41 user nova-compute[72815]:   </cpu>
Aug 17 20:02:41 user nova-compute[72815]:   <devices>
Aug 17 20:02:41 user nova-compute[72815]:     <disk type="file" device="cdrom">
Aug 17 20:02:41 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 20:02:41 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/d45cf87c-d69c-4334-8638-0b92ae395e99/disk.config"/>
Aug 17 20:02:41 user nova-compute[72815]:       <target dev="hda" bus="ide"/>
Aug 17 20:02:41 user nova-compute[72815]:     </disk>
Aug 17 20:02:41 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:02:41 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:02:41 user nova-compute[72815]:       <source dev="/dev/sdb"/>
Aug 17 20:02:41 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:02:41 user nova-compute[72815]:       <serial>14b4030a-a6cd-446d-8014-480d030fabb6</serial>
Aug 17 20:02:41 user nova-compute[72815]:     </disk>
Aug 17 20:02:41 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:02:41 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:02:41 user nova-compute[72815]:       <source dev="/dev/sdd"/>
Aug 17 20:02:41 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 20:02:41 user nova-compute[72815]:       <serial>704aec49-8456-46f7-8d02-b0b837bb7e49</serial>
Aug 17 20:02:41 user nova-compute[72815]:     </disk>
Aug 17 20:02:41 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:02:41 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:02:41 user nova-compute[72815]:       <source dev="/dev/sde"/>
Aug 17 20:02:41 user nova-compute[72815]:       <target dev="vdc" bus="virtio"/>
Aug 17 20:02:41 user nova-compute[72815]:       <serial>57fa4a25-c0db-4be9-bc59-0813a0ead570</serial>
Aug 17 20:02:41 user nova-compute[72815]:     </disk>
Aug 17 20:02:41 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:02:41 user nova-compute[72815]:       <mac address="fa:16:3e:0a:7f:b5"/>
Aug 17 20:02:41 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:02:41 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:02:41 user nova-compute[72815]:       <target dev="tap81faaa84-44"/>
Aug 17 20:02:41 user nova-compute[72815]:     </interface>
Aug 17 20:02:41 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:02:41 user nova-compute[72815]:       <mac address="fa:16:3e:9a:e9:97"/>
Aug 17 20:02:41 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:02:41 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:02:41 user nova-compute[72815]:       <target dev="tap24d97c14-97"/>
Aug 17 20:02:41 user nova-compute[72815]:     </interface>
Aug 17 20:02:41 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:02:41 user nova-compute[72815]:       <mac address="fa:16:3e:24:00:9e"/>
Aug 17 20:02:41 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:02:41 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:02:41 user nova-compute[72815]:       <target dev="tapa8299182-2e"/>
Aug 17 20:02:41 user nova-compute[72815]:     </interface>
Aug 17 20:02:41 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:02:41 user nova-compute[72815]:       <mac address="fa:16:3e:0f:17:59"/>
Aug 17 20:02:41 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:02:41 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:02:41 user nova-compute[72815]:       <target dev="tap72a288ef-76"/>
Aug 17 20:02:41 user nova-compute[72815]:     </interface>
Aug 17 20:02:41 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:02:41 user nova-compute[72815]:       <mac address="fa:16:3e:b3:93:94"/>
Aug 17 20:02:41 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:02:41 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:02:41 user nova-compute[72815]:       <target dev="tap14643db7-4f"/>
Aug 17 20:02:41 user nova-compute[72815]:     </interface>
Aug 17 20:02:41 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:02:41 user nova-compute[72815]:       <mac address="fa:16:3e:aa:e9:9e"/>
Aug 17 20:02:41 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:02:41 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:02:41 user nova-compute[72815]:       <target dev="tap6ba0398c-a9"/>
Aug 17 20:02:41 user nova-compute[72815]:     </interface>
Aug 17 20:02:41 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:02:41 user nova-compute[72815]:       <mac address="fa:16:3e:f6:10:47"/>
Aug 17 20:02:41 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:02:41 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:02:41 user nova-compute[72815]:       <target dev="tape7a8e140-3c"/>
Aug 17 20:02:41 user nova-compute[72815]:     </interface>
Aug 17 20:02:41 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:02:41 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/d45cf87c-d69c-4334-8638-0b92ae395e99/console.log" append="off"/>
Aug 17 20:02:41 user nova-compute[72815]:     </serial>
Aug 17 20:02:41 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:02:41 user nova-compute[72815]:     <video>
Aug 17 20:02:41 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:02:41 user nova-compute[72815]:     </video>
Aug 17 20:02:41 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:02:41 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:02:41 user nova-compute[72815]:     </rng>
Aug 17 20:02:41 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:02:41 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:02:41 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:02:41 user nova-compute[72815]:     </memballoon>
Aug 17 20:02:41 user nova-compute[72815]:   </devices>
Aug 17 20:02:41 user nova-compute[72815]: </domain>
Aug 17 20:02:41 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:7f:b5,bridge_name='br-int',has_traffic_filtering=True,id=81faaa84-44af-45f7-bca9-0bf1dfd299de,network=Network(fb515358-ed40-434f-9826-4d8b6a558fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81faaa84-44') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:7f:b5,bridge_name='br-int',has_traffic_filtering=True,id=81faaa84-44af-45f7-bca9-0bf1dfd299de,network=Network(fb515358-ed40-434f-9826-4d8b6a558fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81faaa84-44') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81faaa84-44, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81faaa84-44, col_values=(('external_ids', {'iface-id': '81faaa84-44af-45f7-bca9-0bf1dfd299de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:7f:b5', 'vm-uuid': 'd45cf87c-d69c-4334-8638-0b92ae395e99'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: INFO os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:7f:b5,bridge_name='br-int',has_traffic_filtering=True,id=81faaa84-44af-45f7-bca9-0bf1dfd299de,network=Network(fb515358-ed40-434f-9826-4d8b6a558fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81faaa84-44')
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e9:97,bridge_name='br-int',has_traffic_filtering=True,id=24d97c14-9767-4d76-a34c-b8e5d4585592,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24d97c14-97') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e9:97,bridge_name='br-int',has_traffic_filtering=True,id=24d97c14-9767-4d76-a34c-b8e5d4585592,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24d97c14-97') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24d97c14-97, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24d97c14-97, col_values=(('external_ids', {'iface-id': '24d97c14-9767-4d76-a34c-b8e5d4585592', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:e9:97', 'vm-uuid': 'd45cf87c-d69c-4334-8638-0b92ae395e99'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: INFO os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e9:97,bridge_name='br-int',has_traffic_filtering=True,id=24d97c14-9767-4d76-a34c-b8e5d4585592,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24d97c14-97')
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:00:9e,bridge_name='br-int',has_traffic_filtering=True,id=a8299182-2e48-4a58-83a4-1e546caaeeae,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8299182-2e') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:00:9e,bridge_name='br-int',has_traffic_filtering=True,id=a8299182-2e48-4a58-83a4-1e546caaeeae,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8299182-2e') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8299182-2e, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8299182-2e, col_values=(('external_ids', {'iface-id': 'a8299182-2e48-4a58-83a4-1e546caaeeae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:00:9e', 'vm-uuid': 'd45cf87c-d69c-4334-8638-0b92ae395e99'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: INFO os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:00:9e,bridge_name='br-int',has_traffic_filtering=True,id=a8299182-2e48-4a58-83a4-1e546caaeeae,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8299182-2e')
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:59,bridge_name='br-int',has_traffic_filtering=True,id=72a288ef-76e2-4e98-bb56-8b0d9f28f078,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a288ef-76') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:59,bridge_name='br-int',has_traffic_filtering=True,id=72a288ef-76e2-4e98-bb56-8b0d9f28f078,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a288ef-76') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72a288ef-76, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72a288ef-76, col_values=(('external_ids', {'iface-id': '72a288ef-76e2-4e98-bb56-8b0d9f28f078', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:17:59', 'vm-uuid': 'd45cf87c-d69c-4334-8638-0b92ae395e99'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: INFO os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:59,bridge_name='br-int',has_traffic_filtering=True,id=72a288ef-76e2-4e98-bb56-8b0d9f28f078,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a288ef-76')
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:93:94,bridge_name='br-int',has_traffic_filtering=True,id=14643db7-4fda-41a1-b528-a11fc8dfca07,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14643db7-4f') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:93:94,bridge_name='br-int',has_traffic_filtering=True,id=14643db7-4fda-41a1-b528-a11fc8dfca07,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14643db7-4f') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14643db7-4f, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14643db7-4f, col_values=(('external_ids', {'iface-id': '14643db7-4fda-41a1-b528-a11fc8dfca07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:93:94', 'vm-uuid': 'd45cf87c-d69c-4334-8638-0b92ae395e99'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: INFO os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:93:94,bridge_name='br-int',has_traffic_filtering=True,id=14643db7-4fda-41a1-b528-a11fc8dfca07,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14643db7-4f')
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "address": "fa:16:3e:aa:e9:9e", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba0398c-a9", "ovs_interfaceid": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "address": "fa:16:3e:aa:e9:9e", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba0398c-a9", "ovs_interfaceid": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e9:9e,bridge_name='br-int',has_traffic_filtering=True,id=6ba0398c-a9e2-4608-aa03-f8baed9efa56,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba0398c-a9') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e9:9e,bridge_name='br-int',has_traffic_filtering=True,id=6ba0398c-a9e2-4608-aa03-f8baed9efa56,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba0398c-a9') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ba0398c-a9, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ba0398c-a9, col_values=(('external_ids', {'iface-id': '6ba0398c-a9e2-4608-aa03-f8baed9efa56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:e9:9e', 'vm-uuid': 'd45cf87c-d69c-4334-8638-0b92ae395e99'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: INFO os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e9:9e,bridge_name='br-int',has_traffic_filtering=True,id=6ba0398c-a9e2-4608-aa03-f8baed9efa56,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba0398c-a9')
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "address": "fa:16:3e:f6:10:47", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a8e140-3c", "ovs_interfaceid": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "address": "fa:16:3e:f6:10:47", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a8e140-3c", "ovs_interfaceid": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:47,bridge_name='br-int',has_traffic_filtering=True,id=e7a8e140-3c2b-4a89-af4b-4ccc271357e1,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a8e140-3c') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:47,bridge_name='br-int',has_traffic_filtering=True,id=e7a8e140-3c2b-4a89-af4b-4ccc271357e1,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a8e140-3c') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7a8e140-3c, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7a8e140-3c, col_values=(('external_ids', {'iface-id': 'e7a8e140-3c2b-4a89-af4b-4ccc271357e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:10:47', 'vm-uuid': 'd45cf87c-d69c-4334-8638-0b92ae395e99'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:02:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:42 user nova-compute[72815]: INFO os_vif [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:47,bridge_name='br-int',has_traffic_filtering=True,id=e7a8e140-3c2b-4a89-af4b-4ccc271357e1,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a8e140-3c')
Aug 17 20:02:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] No BDM found with device name hda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:02:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:02:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] No VIF found with MAC fa:16:3e:0a:7f:b5, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:02:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] No VIF found with MAC fa:16:3e:b3:93:94, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:02:42 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Using config drive
Aug 17 20:02:42 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Creating config drive at /opt/stack/data/nova/instances/d45cf87c-d69c-4334-8638-0b92ae395e99/disk.config
Aug 17 20:02:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d45cf87c-d69c-4334-8638-0b92ae395e99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr6sj_tp5 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d45cf87c-d69c-4334-8638-0b92ae395e99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr6sj_tp5" returned: 0 in 0.066s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:42 user nova-compute[72815]: DEBUG nova.objects.instance [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'pci_requests' on Instance uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:42 user nova-compute[72815]: DEBUG nova.objects.instance [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'numa_topology' on Instance uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:02:42 user nova-compute[72815]: INFO nova.compute.claims [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Claim successful on node user
Aug 17 20:02:42 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:02:42 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:02:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:42 user nova-compute[72815]: INFO nova.network.neutron [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updating port b3639567-a71c-4a6c-81b5-0a04aa8800b2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 20:02:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquired lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:43 user nova-compute[72815]: DEBUG nova.network.neutron [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:02:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-d0c3b53e-08f1-4d61-a0ce-150aef659830 req-10851a23-15a0-474a-a711-3a1baacb215f service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-changed-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-d0c3b53e-08f1-4d61-a0ce-150aef659830 req-10851a23-15a0-474a-a711-3a1baacb215f service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Refreshing instance network info cache due to event network-changed-b3639567-a71c-4a6c-81b5-0a04aa8800b2. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:02:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d0c3b53e-08f1-4d61-a0ce-150aef659830 req-10851a23-15a0-474a-a711-3a1baacb215f service nova] Acquiring lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-45d1396e-030e-48f7-a82f-7d2d0b2c3633 req-f44156fd-f36e-4160-9ccc-0bec08c3aadb service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-45d1396e-030e-48f7-a82f-7d2d0b2c3633 req-f44156fd-f36e-4160-9ccc-0bec08c3aadb service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-45d1396e-030e-48f7-a82f-7d2d0b2c3633 req-f44156fd-f36e-4160-9ccc-0bec08c3aadb service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-45d1396e-030e-48f7-a82f-7d2d0b2c3633 req-f44156fd-f36e-4160-9ccc-0bec08c3aadb service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-45d1396e-030e-48f7-a82f-7d2d0b2c3633 req-f44156fd-f36e-4160-9ccc-0bec08c3aadb service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:44 user nova-compute[72815]: WARNING nova.compute.manager [req-45d1396e-030e-48f7-a82f-7d2d0b2c3633 req-f44156fd-f36e-4160-9ccc-0bec08c3aadb service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-81faaa84-44af-45f7-bca9-0bf1dfd299de for instance with vm_state building and task_state spawning.
Aug 17 20:02:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG nova.network.neutron [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updating instance_info_cache with network_info: [{"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Releasing lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:02:44 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Creating image(s)
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "/opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "/opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG nova.objects.instance [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'trusted_certs' on Instance uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d0c3b53e-08f1-4d61-a0ce-150aef659830 req-10851a23-15a0-474a-a711-3a1baacb215f service nova] Acquired lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG nova.network.neutron [req-d0c3b53e-08f1-4d61-a0ce-150aef659830 req-10851a23-15a0-474a-a711-3a1baacb215f service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Refreshing network info cache for port b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-a93f81c7-2e65-40ef-a67e-016c1f7d9e32 req-a16bbf51-515c-4e3e-bbc1-710a229e35cc service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-24d97c14-9767-4d76-a34c-b8e5d4585592 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a93f81c7-2e65-40ef-a67e-016c1f7d9e32 req-a16bbf51-515c-4e3e-bbc1-710a229e35cc service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a93f81c7-2e65-40ef-a67e-016c1f7d9e32 req-a16bbf51-515c-4e3e-bbc1-710a229e35cc service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a93f81c7-2e65-40ef-a67e-016c1f7d9e32 req-a16bbf51-515c-4e3e-bbc1-710a229e35cc service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-a93f81c7-2e65-40ef-a67e-016c1f7d9e32 req-a16bbf51-515c-4e3e-bbc1-710a229e35cc service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-24d97c14-9767-4d76-a34c-b8e5d4585592 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:44 user nova-compute[72815]: WARNING nova.compute.manager [req-a93f81c7-2e65-40ef-a67e-016c1f7d9e32 req-a16bbf51-515c-4e3e-bbc1-710a229e35cc service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-24d97c14-9767-4d76-a34c-b8e5d4585592 for instance with vm_state building and task_state spawning.
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "0af8a97a7153b827c926f3483d668713830295ea" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "0af8a97a7153b827c926f3483d668713830295ea" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea.part --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea.part --force-share --output=json" returned: 0 in 0.215s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG nova.virt.images [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] 530f4758-6531-4612-a77e-61b351806cd9 was qcow2, converting to raw {{(pid=72815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea.part /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea.converted {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-871ce18c-f163-449e-94b7-5f061aea894b req-6a830c95-18ba-4c75-a168-b1224e1f1b45 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-871ce18c-f163-449e-94b7-5f061aea894b req-6a830c95-18ba-4c75-a168-b1224e1f1b45 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-871ce18c-f163-449e-94b7-5f061aea894b req-6a830c95-18ba-4c75-a168-b1224e1f1b45 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-871ce18c-f163-449e-94b7-5f061aea894b req-6a830c95-18ba-4c75-a168-b1224e1f1b45 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-871ce18c-f163-449e-94b7-5f061aea894b req-6a830c95-18ba-4c75-a168-b1224e1f1b45 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:45 user nova-compute[72815]: WARNING nova.compute.manager [req-871ce18c-f163-449e-94b7-5f061aea894b req-6a830c95-18ba-4c75-a168-b1224e1f1b45 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-72a288ef-76e2-4e98-bb56-8b0d9f28f078 for instance with vm_state building and task_state spawning.
Aug 17 20:02:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-871ce18c-f163-449e-94b7-5f061aea894b req-6a830c95-18ba-4c75-a168-b1224e1f1b45 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-871ce18c-f163-449e-94b7-5f061aea894b req-6a830c95-18ba-4c75-a168-b1224e1f1b45 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-871ce18c-f163-449e-94b7-5f061aea894b req-6a830c95-18ba-4c75-a168-b1224e1f1b45 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-871ce18c-f163-449e-94b7-5f061aea894b req-6a830c95-18ba-4c75-a168-b1224e1f1b45 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-871ce18c-f163-449e-94b7-5f061aea894b req-6a830c95-18ba-4c75-a168-b1224e1f1b45 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:45 user nova-compute[72815]: WARNING nova.compute.manager [req-871ce18c-f163-449e-94b7-5f061aea894b req-6a830c95-18ba-4c75-a168-b1224e1f1b45 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-72a288ef-76e2-4e98-bb56-8b0d9f28f078 for instance with vm_state building and task_state spawning.
Aug 17 20:02:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-7605b696-79aa-49bf-893f-9ef76197c53e req-2c846981-0bc6-4cdf-9d3f-5cd66b0284fd service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7605b696-79aa-49bf-893f-9ef76197c53e req-2c846981-0bc6-4cdf-9d3f-5cd66b0284fd service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7605b696-79aa-49bf-893f-9ef76197c53e req-2c846981-0bc6-4cdf-9d3f-5cd66b0284fd service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7605b696-79aa-49bf-893f-9ef76197c53e req-2c846981-0bc6-4cdf-9d3f-5cd66b0284fd service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-7605b696-79aa-49bf-893f-9ef76197c53e req-2c846981-0bc6-4cdf-9d3f-5cd66b0284fd service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:46 user nova-compute[72815]: WARNING nova.compute.manager [req-7605b696-79aa-49bf-893f-9ef76197c53e req-2c846981-0bc6-4cdf-9d3f-5cd66b0284fd service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-81faaa84-44af-45f7-bca9-0bf1dfd299de for instance with vm_state building and task_state spawning.
Aug 17 20:02:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-24d97c14-9767-4d76-a34c-b8e5d4585592 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-24d97c14-9767-4d76-a34c-b8e5d4585592 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:46 user nova-compute[72815]: WARNING nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-24d97c14-9767-4d76-a34c-b8e5d4585592 for instance with vm_state building and task_state spawning.
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-a8299182-2e48-4a58-83a4-1e546caaeeae {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-a8299182-2e48-4a58-83a4-1e546caaeeae {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:46 user nova-compute[72815]: WARNING nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-a8299182-2e48-4a58-83a4-1e546caaeeae for instance with vm_state building and task_state spawning.
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-a8299182-2e48-4a58-83a4-1e546caaeeae {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-a8299182-2e48-4a58-83a4-1e546caaeeae {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:46 user nova-compute[72815]: WARNING nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-a8299182-2e48-4a58-83a4-1e546caaeeae for instance with vm_state building and task_state spawning.
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:46 user nova-compute[72815]: WARNING nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-14643db7-4fda-41a1-b528-a11fc8dfca07 for instance with vm_state building and task_state spawning.
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:46 user nova-compute[72815]: WARNING nova.compute.manager [req-5f467598-1e75-4d17-b2c3-881ea380860d req-a580eec4-ffea-4b1f-8359-e4a2c84192f3 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-14643db7-4fda-41a1-b528-a11fc8dfca07 for instance with vm_state building and task_state spawning.
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea.part /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea.converted" returned: 0 in 0.740s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea.converted --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.network.neutron [req-d0c3b53e-08f1-4d61-a0ce-150aef659830 req-10851a23-15a0-474a-a711-3a1baacb215f service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updated VIF entry in instance network info cache for port b3639567-a71c-4a6c-81b5-0a04aa8800b2. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.network.neutron [req-d0c3b53e-08f1-4d61-a0ce-150aef659830 req-10851a23-15a0-474a-a711-3a1baacb215f service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updating instance_info_cache with network_info: [{"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d0c3b53e-08f1-4d61-a0ce-150aef659830 req-10851a23-15a0-474a-a711-3a1baacb215f service nova] Releasing lock "refresh_cache-ee4a8248-9abc-45b3-9bf6-349c4d11f189" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea.converted --force-share --output=json" returned: 0 in 0.235s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "0af8a97a7153b827c926f3483d668713830295ea" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.340s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Port e936e6d3-48e1-4322-b2d4-779037eff32c binding to destination host user is already ACTIVE {{(pid=72815) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquired lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "0af8a97a7153b827c926f3483d668713830295ea" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "0af8a97a7153b827c926f3483d668713830295ea" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea --force-share --output=json" returned: 0 in 0.230s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea,backing_fmt=raw /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea,backing_fmt=raw /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk 1073741824" returned: 0 in 0.052s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "0af8a97a7153b827c926f3483d668713830295ea" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG nova.objects.instance [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'migration_context' on Instance uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:47 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Rebasing disk image.
Aug 17 20:02:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 -F raw /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating instance_info_cache with network_info: [{"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Releasing lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Creating tmpfile /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/tmpczw6p1nw to verify with other compute node that the instance is on the same shared storage. {{(pid=72815) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-d35501a3-44c0-4817-b96a-ff42bdceccce req-d72b74f1-88e3-440c-a7f8-e98dde8d756f service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d35501a3-44c0-4817-b96a-ff42bdceccce req-d72b74f1-88e3-440c-a7f8-e98dde8d756f service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d35501a3-44c0-4817-b96a-ff42bdceccce req-d72b74f1-88e3-440c-a7f8-e98dde8d756f service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d35501a3-44c0-4817-b96a-ff42bdceccce req-d72b74f1-88e3-440c-a7f8-e98dde8d756f service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-d35501a3-44c0-4817-b96a-ff42bdceccce req-d72b74f1-88e3-440c-a7f8-e98dde8d756f service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:48 user nova-compute[72815]: WARNING nova.compute.manager [req-d35501a3-44c0-4817-b96a-ff42bdceccce req-d72b74f1-88e3-440c-a7f8-e98dde8d756f service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 for instance with vm_state building and task_state spawning.
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-d35501a3-44c0-4817-b96a-ff42bdceccce req-d72b74f1-88e3-440c-a7f8-e98dde8d756f service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d35501a3-44c0-4817-b96a-ff42bdceccce req-d72b74f1-88e3-440c-a7f8-e98dde8d756f service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d35501a3-44c0-4817-b96a-ff42bdceccce req-d72b74f1-88e3-440c-a7f8-e98dde8d756f service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d35501a3-44c0-4817-b96a-ff42bdceccce req-d72b74f1-88e3-440c-a7f8-e98dde8d756f service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-d35501a3-44c0-4817-b96a-ff42bdceccce req-d72b74f1-88e3-440c-a7f8-e98dde8d756f service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:48 user nova-compute[72815]: WARNING nova.compute.manager [req-d35501a3-44c0-4817-b96a-ff42bdceccce req-d72b74f1-88e3-440c-a7f8-e98dde8d756f service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 for instance with vm_state building and task_state spawning.
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302568.356979, d45cf87c-d69c-4334-8638-0b92ae395e99 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:02:48 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] VM Resumed (Lifecycle Event)
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:02:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Instance spawned successfully.
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:02:48 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302568.3574657, d45cf87c-d69c-4334-8638-0b92ae395e99 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:02:48 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] VM Started (Lifecycle Event)
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:02:48 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:48 user nova-compute[72815]: WARNING nova.compute.manager [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-6ba0398c-a9e2-4608-aa03-f8baed9efa56 for instance with vm_state building and task_state spawning.
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:48 user nova-compute[72815]: WARNING nova.compute.manager [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-6ba0398c-a9e2-4608-aa03-f8baed9efa56 for instance with vm_state building and task_state spawning.
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-unplugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] No waiting events found dispatching network-vif-unplugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:48 user nova-compute[72815]: WARNING nova.compute.manager [req-d066c9f7-7bd6-4838-8d85-cd8bae3d1ff2 req-b601b23b-81e2-48ea-960f-764c6e14fd17 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received unexpected event network-vif-unplugged-e936e6d3-48e1-4322-b2d4-779037eff32c for instance with vm_state resized and task_state resize_reverting.
Aug 17 20:02:48 user nova-compute[72815]: INFO nova.compute.manager [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Took 11.10 seconds to spawn the instance on the hypervisor.
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:02:48 user nova-compute[72815]: INFO nova.compute.manager [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Took 50.68 seconds to build instance.
Aug 17 20:02:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Instance destroyed successfully.
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'resources' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5961480f-07a8-44bb-b874-e6505e76c248 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.784s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-468217050',display_name='tempest-ServerActionsTestOtherB-server-468217050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-468217050',id=14,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpS9twCAKB9Qcxa77kKBv1mcMWNNwvJ8PtuQNagNxi+2wHS7dCki+1ibMc73BH5JCIYY5sRP3ThGzFZPpzGom37joOakxOGFFMKzFdXVL+/I3uzE68ATLp8T4Wn8HgTCg==',key_name='tempest-keypair-1805104337',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:01:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f0bfaa4f27c4bf1bf6be9b74b9f8a09',ramdisk_id='',reservation_id='r-8y7ruqfi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-166537402',owner_user_name='tempest-ServerActionsTestOtherB-166537402-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03912162ae0f4b299c8c7b044b61798f',uuid=3a4f27f3-4573-43b5-827a-bbdae4ebce10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converting VIF {"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG os_vif [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape936e6d3-48, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:02:48 user nova-compute[72815]: INFO os_vif [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48')
Aug 17 20:02:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrhyWBRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:02:48 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:02:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d3ac5d-e418-4d08-9425-cd5ffaab00f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b29ef0-8bde-40ab-80bb-5ca268240571]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:48 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:48 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:48 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:02:48 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:02:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:48 user nova-compute[72815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:02:48 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:48 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:02:48 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:02:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b430ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094'): ({'sdh'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Removing single pathed devices sdh {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.060s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[171e18a0-d39b-4174-ba00-22c02d0272a5]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.033s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02cd787-2ed9-4354-bc6e-d9c4506f8444]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Flushing IO for device /dev/sdh {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3267ea16-db5b-4afe-8057-1449600ddced]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:02:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302554.158993, a5f4e2b3-6d84-418d-9109-07a4362b4d7b => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:02:49 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] VM Stopped (Lifecycle Event)
Aug 17 20:02:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.229s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae295d9-2605-48f7-ac5a-f7695438ea90]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] SCSI volumes sdh have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-32cf8fa2-1d6f-44c9-a097-1af8bd19a926 None None] [instance: a5f4e2b3-6d84-418d-9109-07a4362b4d7b] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.103s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52cc227-db8a-4cb4-a20b-0337bcf60c80]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bddfa99-66a5-4b57-9649-2a455210f41e]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260]
Aug 17 20:02:49 user nova-compute[72815]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260] successful.
Aug 17 20:02:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a966474b-7138-4366-944a-083d2b74e14a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.704s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] <== disconnect_volume: return (705ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:02:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 -F raw /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk" returned: 0 in 2.600s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Ensure instance console log exists: /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Start _get_guest_xml network_info=[{"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c822fb5b3fe45903351a910cd56d32cc',container_format='bare',created_at=2023-08-17T20:00:37Z,direct_url=<?>,disk_format='qcow2',id=530f4758-6531-4612-a77e-61b351806cd9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1768421689-shelved',owner='aa140294f17e4751b13e2d4a15b17ff9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T20:00:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': '7ce2d11b-0a05-4f74-baa8-4cac45def8ce', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuJzPXSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'ee4a8248-9abc-45b3-9bf6-349c4d11f189', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb', 'serial': 'a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:02:50 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:02:50 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c822fb5b3fe45903351a910cd56d32cc',container_format='bare',created_at=2023-08-17T20:00:37Z,direct_url=<?>,disk_format='qcow2',id=530f4758-6531-4612-a77e-61b351806cd9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1768421689-shelved',owner='aa140294f17e4751b13e2d4a15b17ff9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T20:00:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.objects.instance [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuJzPXSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:02:50 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:02:50 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:02:50 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93cf8f6-5921-4fdf-a7bb-857aab5bfdd6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:02:50 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.045s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c019c51b-c5b5-49f5-be81-012ce3f2ebfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb] added
Aug 17 20:02:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55cd91b-3f97-43e5-a200-ccc5cb543731]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a53678-6377-4188-96a0-5d47dc95ee78]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EuJzPXSg {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EuJzPXSg" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9680ddfa-fc25-45d8-a7a8-7ba5e5d6b174]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EuJzPXSg'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f84929-e466-4fba-9234-1316d586b6ab]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'migration_context' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e15075-92a8-46c3-a257-748ebbacd33f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:02:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:02:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-b5ee8a3c-4e3d-4a48-a452-074064b90673 req-6c3091bf-3f6d-435a-b5fc-0a4120699ad1 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b5ee8a3c-4e3d-4a48-a452-074064b90673 req-6c3091bf-3f6d-435a-b5fc-0a4120699ad1 service nova] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b5ee8a3c-4e3d-4a48-a452-074064b90673 req-6c3091bf-3f6d-435a-b5fc-0a4120699ad1 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b5ee8a3c-4e3d-4a48-a452-074064b90673 req-6c3091bf-3f6d-435a-b5fc-0a4120699ad1 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-b5ee8a3c-4e3d-4a48-a452-074064b90673 req-6c3091bf-3f6d-435a-b5fc-0a4120699ad1 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] No waiting events found dispatching network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:50 user nova-compute[72815]: WARNING nova.compute.manager [req-b5ee8a3c-4e3d-4a48-a452-074064b90673 req-6c3091bf-3f6d-435a-b5fc-0a4120699ad1 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received unexpected event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c for instance with vm_state resized and task_state resize_reverting.
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b99abda-70b5-487e-864b-bc480be1cb6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb, portal: 172.16.0.220,3260]
Aug 17 20:02:50 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb, portal: 172.16.0.220,3260] successful.
Aug 17 20:02:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[444b46ba-1199-4a6f-a0df-a36fb65b082c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2fe844-c685-4306-b9a6-a140880abc3d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:02:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:02:50 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:02:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c3f572-246c-4599-9e0a-8764baa3cab8]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:02:50 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.594s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:51 user nova-compute[72815]: INFO nova.compute.manager [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Swapping old allocation on dict_keys(['d6bf6002-de69-45c8-b950-cf2491d2cb73']) held by migration 7aa604a3-81e6-40fb-8398-85a8710bd4bd for instance
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Overwriting current allocation {'allocations': {'d6bf6002-de69-45c8-b950-cf2491d2cb73': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 30}}, 'project_id': '6f0bfaa4f27c4bf1bf6be9b74b9f8a09', 'user_id': '03912162ae0f4b299c8c7b044b61798f', 'consumer_generation': 1} on consumer 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquired lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuJzPXSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23365303338326631', 'path': '/dev/sdf'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365303338326631', 'path': '/dev/sdf'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T19:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1768421689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1768421689',id=17,image_ref='530f4758-6531-4612-a77e-61b351806cd9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1366413119',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='aa140294f17e4751b13e2d4a15b17ff9',ramdisk_id='',reservation_id='r-lho37lud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-632866040',owner_user_name='tempest-AttachVolumeShelveTestJSON-632866040-project-member',shelved_at='2023-08-17T20:00:41.686699',shelved_host='user',shelved_image_id='530f4758-6531-4612-a77e-61b351806cd9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82d9b206cf4499eaf518f7cd6a7a10c',uuid=ee4a8248-9abc-45b3-9bf6-349c4d11f189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converting VIF {"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.objects.instance [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'pci_devices' on Instance uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:02:51 user nova-compute[72815]:   <uuid>ee4a8248-9abc-45b3-9bf6-349c4d11f189</uuid>
Aug 17 20:02:51 user nova-compute[72815]:   <name>instance-00000011</name>
Aug 17 20:02:51 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:02:51 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:02:51 user nova-compute[72815]:   <metadata>
Aug 17 20:02:51 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:02:51 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:02:51 user nova-compute[72815]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1768421689</nova:name>
Aug 17 20:02:51 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:02:50</nova:creationTime>
Aug 17 20:02:51 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:02:51 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:02:51 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:02:51 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:02:51 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:02:51 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:02:51 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:02:51 user nova-compute[72815]:       <nova:owner>
Aug 17 20:02:51 user nova-compute[72815]:         <nova:user uuid="a82d9b206cf4499eaf518f7cd6a7a10c">tempest-AttachVolumeShelveTestJSON-632866040-project-member</nova:user>
Aug 17 20:02:51 user nova-compute[72815]:         <nova:project uuid="aa140294f17e4751b13e2d4a15b17ff9">tempest-AttachVolumeShelveTestJSON-632866040</nova:project>
Aug 17 20:02:51 user nova-compute[72815]:       </nova:owner>
Aug 17 20:02:51 user nova-compute[72815]:       <nova:root type="image" uuid="530f4758-6531-4612-a77e-61b351806cd9"/>
Aug 17 20:02:51 user nova-compute[72815]:       <nova:ports>
Aug 17 20:02:51 user nova-compute[72815]:         <nova:port uuid="b3639567-a71c-4a6c-81b5-0a04aa8800b2">
Aug 17 20:02:51 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 20:02:51 user nova-compute[72815]:         </nova:port>
Aug 17 20:02:51 user nova-compute[72815]:       </nova:ports>
Aug 17 20:02:51 user nova-compute[72815]:     </nova:instance>
Aug 17 20:02:51 user nova-compute[72815]:   </metadata>
Aug 17 20:02:51 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:02:51 user nova-compute[72815]:     <system>
Aug 17 20:02:51 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:02:51 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:02:51 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:02:51 user nova-compute[72815]:       <entry name="serial">ee4a8248-9abc-45b3-9bf6-349c4d11f189</entry>
Aug 17 20:02:51 user nova-compute[72815]:       <entry name="uuid">ee4a8248-9abc-45b3-9bf6-349c4d11f189</entry>
Aug 17 20:02:51 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:02:51 user nova-compute[72815]:     </system>
Aug 17 20:02:51 user nova-compute[72815]:   </sysinfo>
Aug 17 20:02:51 user nova-compute[72815]:   <os>
Aug 17 20:02:51 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:02:51 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:02:51 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:02:51 user nova-compute[72815]:   </os>
Aug 17 20:02:51 user nova-compute[72815]:   <features>
Aug 17 20:02:51 user nova-compute[72815]:     <acpi/>
Aug 17 20:02:51 user nova-compute[72815]:     <apic/>
Aug 17 20:02:51 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:02:51 user nova-compute[72815]:   </features>
Aug 17 20:02:51 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:02:51 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:02:51 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:02:51 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:02:51 user nova-compute[72815]:   </clock>
Aug 17 20:02:51 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:02:51 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:02:51 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:02:51 user nova-compute[72815]:   </cpu>
Aug 17 20:02:51 user nova-compute[72815]:   <devices>
Aug 17 20:02:51 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:02:51 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:02:51 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk"/>
Aug 17 20:02:51 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:02:51 user nova-compute[72815]:     </disk>
Aug 17 20:02:51 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:02:51 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:02:51 user nova-compute[72815]:       <source dev="/dev/sdf"/>
Aug 17 20:02:51 user nova-compute[72815]:       <target dev="vdc" bus="virtio"/>
Aug 17 20:02:51 user nova-compute[72815]:       <serial>a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb</serial>
Aug 17 20:02:51 user nova-compute[72815]:     </disk>
Aug 17 20:02:51 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:02:51 user nova-compute[72815]:       <mac address="fa:16:3e:4e:df:a1"/>
Aug 17 20:02:51 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:02:51 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:02:51 user nova-compute[72815]:       <target dev="tapb3639567-a7"/>
Aug 17 20:02:51 user nova-compute[72815]:     </interface>
Aug 17 20:02:51 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:02:51 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/console.log" append="off"/>
Aug 17 20:02:51 user nova-compute[72815]:     </serial>
Aug 17 20:02:51 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:02:51 user nova-compute[72815]:     <video>
Aug 17 20:02:51 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:02:51 user nova-compute[72815]:     </video>
Aug 17 20:02:51 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:02:51 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:02:51 user nova-compute[72815]:     </rng>
Aug 17 20:02:51 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:02:51 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:02:51 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:02:51 user nova-compute[72815]:     </memballoon>
Aug 17 20:02:51 user nova-compute[72815]:   </devices>
Aug 17 20:02:51 user nova-compute[72815]: </domain>
Aug 17 20:02:51 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T19:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1768421689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1768421689',id=17,image_ref='530f4758-6531-4612-a77e-61b351806cd9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1366413119',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='aa140294f17e4751b13e2d4a15b17ff9',ramdisk_id='',reservation_id='r-lho37lud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-632866040',owner_user_name='tempest-AttachVolumeShelveTestJSON-632866040-project-member',shelved_at='2023-08-17T20:00:41.686699',shelved_host='user',shelved_image_id='530f4758-6531-4612-a77e-61b351806cd9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82d9b206cf4499eaf518f7cd6a7a10c',uuid=ee4a8248-9abc-45b3-9bf6-349c4d11f189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converting VIF {"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG os_vif [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3639567-a7, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3639567-a7, col_values=(('external_ids', {'iface-id': 'b3639567-a71c-4a6c-81b5-0a04aa8800b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:df:a1', 'vm-uuid': 'ee4a8248-9abc-45b3-9bf6-349c4d11f189'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:51 user nova-compute[72815]: INFO os_vif [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7')
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:02:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] No VIF found with MAC fa:16:3e:4e:df:a1, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating instance_info_cache with network_info: [{"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Releasing lock "refresh_cache-3a4f27f3-4573-43b5-827a-bbdae4ebce10" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG os_brick.utils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cced5b57-4129-4387-9562-b75b7ccbffd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1616e2-20b8-4b62-ab27-1b87135f44de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2855130c-468b-43cd-ab36-cedad10fa652]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd5ef5d-be65-4ad4-9d1c-69299f23fb67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:02:52 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:02:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3486bef-af8b-4400-947e-fe179825aa65]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:02:52 user nova-compute[72815]: DEBUG os_brick.utils [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:02:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-eb550f07-31b9-478b-8b3a-882fe6cf6225 req-6881cff7-afd5-4e81-80a4-b3b32d2e0ea9 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-eb550f07-31b9-478b-8b3a-882fe6cf6225 req-6881cff7-afd5-4e81-80a4-b3b32d2e0ea9 service nova] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-eb550f07-31b9-478b-8b3a-882fe6cf6225 req-6881cff7-afd5-4e81-80a4-b3b32d2e0ea9 service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-eb550f07-31b9-478b-8b3a-882fe6cf6225 req-6881cff7-afd5-4e81-80a4-b3b32d2e0ea9 service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-eb550f07-31b9-478b-8b3a-882fe6cf6225 req-6881cff7-afd5-4e81-80a4-b3b32d2e0ea9 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] No waiting events found dispatching network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:53 user nova-compute[72815]: WARNING nova.compute.manager [req-eb550f07-31b9-478b-8b3a-882fe6cf6225 req-6881cff7-afd5-4e81-80a4-b3b32d2e0ea9 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received unexpected event network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 20:02:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-1ee9cc9b-59d9-40fe-bf3c-3236789883b8 req-31d28c23-ba4c-4e7f-a5be-dbf9de877857 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:02:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ee9cc9b-59d9-40fe-bf3c-3236789883b8 req-31d28c23-ba4c-4e7f-a5be-dbf9de877857 service nova] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:02:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ee9cc9b-59d9-40fe-bf3c-3236789883b8 req-31d28c23-ba4c-4e7f-a5be-dbf9de877857 service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:02:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ee9cc9b-59d9-40fe-bf3c-3236789883b8 req-31d28c23-ba4c-4e7f-a5be-dbf9de877857 service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-1ee9cc9b-59d9-40fe-bf3c-3236789883b8 req-31d28c23-ba4c-4e7f-a5be-dbf9de877857 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] No waiting events found dispatching network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:02:55 user nova-compute[72815]: WARNING nova.compute.manager [req-1ee9cc9b-59d9-40fe-bf3c-3236789883b8 req-31d28c23-ba4c-4e7f-a5be-dbf9de877857 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received unexpected event network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 20:02:55 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302575.9090807, ee4a8248-9abc-45b3-9bf6-349c4d11f189 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:02:55 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] VM Resumed (Lifecycle Event)
Aug 17 20:02:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:02:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:02:55 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Instance spawned successfully.
Aug 17 20:02:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:02:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:02:56 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:02:56 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302575.921188, ee4a8248-9abc-45b3-9bf6-349c4d11f189 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:02:56 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] VM Started (Lifecycle Event)
Aug 17 20:02:56 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:02:56 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:02:56 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:02:56 user nova-compute[72815]: DEBUG nova.compute.manager [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:02:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-28f8a966-4327-48c0-80fd-79f89f104fbb tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.828s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:02:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:02:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:03 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302568.6254704, 3a4f27f3-4573-43b5-827a-bbdae4ebce10 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:03:03 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] VM Stopped (Lifecycle Event)
Aug 17 20:03:03 user nova-compute[72815]: DEBUG nova.compute.manager [None req-b8d3d6b4-b1d5-446e-9998-b3cafd7ab415 None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Starting finish_revert_migration {{(pid=72815) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Start _get_guest_xml network_info=[{"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': '2be6c9a3-fda6-4c0f-a58f-2aa4462f627e', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrhyWBRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3a4f27f3-4573-43b5-827a-bbdae4ebce10', 'attached_at': '2023-08-17T20:03:06.000000', 'detached_at': '', 'volume_id': '30b8cda4-cfa8-47e8-bed3-21de5c735094', 'serial': '30b8cda4-cfa8-47e8-bed3-21de5c735094'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:03:05 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:03:05 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrhyWBRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:03:05 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:03:05 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:03:05 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0f438e-90fa-4a4b-8830-1e8a33325714]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:03:05 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd78adc-7108-46bf-81cb-27abca12db3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094] added
Aug 17 20:03:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2c9606-ce7a-42cc-b77b-df2034f0d8ec]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e753e4c-4c15-4f4f-afec-f48473d06881]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrhyWBRq {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrhyWBRq" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1b2dab-dfd5-42e0-9184-2c8dd6730a86]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SrhyWBRq'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.051s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[42209f72-cdc9-485e-b720-142bf50c35c7]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe38705-255d-4d89-952c-04c9aa18ecf0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:03:05 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:03:05 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:03:05 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:03:05 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:03:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:03:05 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:03:05 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:03:05 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:03:05 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:03:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:03:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e01d8b-62cb-487d-b8e2-daa60414cd8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260]
Aug 17 20:03:06 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260] successful.
Aug 17 20:03:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c146993d-0705-463a-8769-20d6dfaac790]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6ad9f5-2665-4784-a18c-ecacf59aead1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:03:06 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:03:06 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:03:06 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:03:06 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:03:06 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:03:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:03:06 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:03:06 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:03:06 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:03:06 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:03:06 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:03:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.352s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[622ad0d7-4eb8-47c5-a171-e1dca1e97264]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrhyWBRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:03:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.754s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] <== connect_volume: return (1756ms) {'type': 'block', 'scsi_wwn': '23036623166323937', 'path': '/dev/sdg'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036623166323937', 'path': '/dev/sdg'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-468217050',display_name='tempest-ServerActionsTestOtherB-server-468217050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-468217050',id=14,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpS9twCAKB9Qcxa77kKBv1mcMWNNwvJ8PtuQNagNxi+2wHS7dCki+1ibMc73BH5JCIYY5sRP3ThGzFZPpzGom37joOakxOGFFMKzFdXVL+/I3uzE68ATLp8T4Wn8HgTCg==',key_name='tempest-keypair-1805104337',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:01:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f0bfaa4f27c4bf1bf6be9b74b9f8a09',ramdisk_id='',reservation_id='r-8y7ruqfi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-166537402',owner_user_name='tempest-ServerActionsTestOtherB-166537402-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:02:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03912162ae0f4b299c8c7b044b61798f',uuid=3a4f27f3-4573-43b5-827a-bbdae4ebce10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converting VIF {"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:03:07 user nova-compute[72815]:   <uuid>3a4f27f3-4573-43b5-827a-bbdae4ebce10</uuid>
Aug 17 20:03:07 user nova-compute[72815]:   <name>instance-0000000e</name>
Aug 17 20:03:07 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:03:07 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:03:07 user nova-compute[72815]:   <metadata>
Aug 17 20:03:07 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:03:07 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:03:07 user nova-compute[72815]:       <nova:name>tempest-ServerActionsTestOtherB-server-468217050</nova:name>
Aug 17 20:03:07 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:03:05</nova:creationTime>
Aug 17 20:03:07 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:03:07 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:03:07 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:03:07 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:03:07 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:03:07 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:03:07 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:03:07 user nova-compute[72815]:       <nova:owner>
Aug 17 20:03:07 user nova-compute[72815]:         <nova:user uuid="03912162ae0f4b299c8c7b044b61798f">tempest-ServerActionsTestOtherB-166537402-project-member</nova:user>
Aug 17 20:03:07 user nova-compute[72815]:         <nova:project uuid="6f0bfaa4f27c4bf1bf6be9b74b9f8a09">tempest-ServerActionsTestOtherB-166537402</nova:project>
Aug 17 20:03:07 user nova-compute[72815]:       </nova:owner>
Aug 17 20:03:07 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:03:07 user nova-compute[72815]:       <nova:ports>
Aug 17 20:03:07 user nova-compute[72815]:         <nova:port uuid="e936e6d3-48e1-4322-b2d4-779037eff32c">
Aug 17 20:03:07 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 20:03:07 user nova-compute[72815]:         </nova:port>
Aug 17 20:03:07 user nova-compute[72815]:       </nova:ports>
Aug 17 20:03:07 user nova-compute[72815]:     </nova:instance>
Aug 17 20:03:07 user nova-compute[72815]:   </metadata>
Aug 17 20:03:07 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:03:07 user nova-compute[72815]:     <system>
Aug 17 20:03:07 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:03:07 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:03:07 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:03:07 user nova-compute[72815]:       <entry name="serial">3a4f27f3-4573-43b5-827a-bbdae4ebce10</entry>
Aug 17 20:03:07 user nova-compute[72815]:       <entry name="uuid">3a4f27f3-4573-43b5-827a-bbdae4ebce10</entry>
Aug 17 20:03:07 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:03:07 user nova-compute[72815]:     </system>
Aug 17 20:03:07 user nova-compute[72815]:   </sysinfo>
Aug 17 20:03:07 user nova-compute[72815]:   <os>
Aug 17 20:03:07 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:03:07 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:03:07 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:03:07 user nova-compute[72815]:   </os>
Aug 17 20:03:07 user nova-compute[72815]:   <features>
Aug 17 20:03:07 user nova-compute[72815]:     <acpi/>
Aug 17 20:03:07 user nova-compute[72815]:     <apic/>
Aug 17 20:03:07 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:03:07 user nova-compute[72815]:   </features>
Aug 17 20:03:07 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:03:07 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:03:07 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:03:07 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:03:07 user nova-compute[72815]:   </clock>
Aug 17 20:03:07 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:03:07 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:03:07 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:03:07 user nova-compute[72815]:   </cpu>
Aug 17 20:03:07 user nova-compute[72815]:   <devices>
Aug 17 20:03:07 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:03:07 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:03:07 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk"/>
Aug 17 20:03:07 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:03:07 user nova-compute[72815]:     </disk>
Aug 17 20:03:07 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:03:07 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:03:07 user nova-compute[72815]:       <source dev="/dev/sdg"/>
Aug 17 20:03:07 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 20:03:07 user nova-compute[72815]:       <serial>30b8cda4-cfa8-47e8-bed3-21de5c735094</serial>
Aug 17 20:03:07 user nova-compute[72815]:     </disk>
Aug 17 20:03:07 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:03:07 user nova-compute[72815]:       <mac address="fa:16:3e:7f:6e:78"/>
Aug 17 20:03:07 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:03:07 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:03:07 user nova-compute[72815]:       <target dev="tape936e6d3-48"/>
Aug 17 20:03:07 user nova-compute[72815]:     </interface>
Aug 17 20:03:07 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:03:07 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/console.log" append="off"/>
Aug 17 20:03:07 user nova-compute[72815]:     </serial>
Aug 17 20:03:07 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:03:07 user nova-compute[72815]:     <video>
Aug 17 20:03:07 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:03:07 user nova-compute[72815]:     </video>
Aug 17 20:03:07 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:03:07 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:03:07 user nova-compute[72815]:     </rng>
Aug 17 20:03:07 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:03:07 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:03:07 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:03:07 user nova-compute[72815]:     </memballoon>
Aug 17 20:03:07 user nova-compute[72815]:   </devices>
Aug 17 20:03:07 user nova-compute[72815]: </domain>
Aug 17 20:03:07 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-468217050',display_name='tempest-ServerActionsTestOtherB-server-468217050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-468217050',id=14,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpS9twCAKB9Qcxa77kKBv1mcMWNNwvJ8PtuQNagNxi+2wHS7dCki+1ibMc73BH5JCIYY5sRP3ThGzFZPpzGom37joOakxOGFFMKzFdXVL+/I3uzE68ATLp8T4Wn8HgTCg==',key_name='tempest-keypair-1805104337',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:01:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f0bfaa4f27c4bf1bf6be9b74b9f8a09',ramdisk_id='',reservation_id='r-8y7ruqfi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-166537402',owner_user_name='tempest-ServerActionsTestOtherB-166537402-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:02:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03912162ae0f4b299c8c7b044b61798f',uuid=3a4f27f3-4573-43b5-827a-bbdae4ebce10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converting VIF {"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG os_vif [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape936e6d3-48, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape936e6d3-48, col_values=(('external_ids', {'iface-id': 'e936e6d3-48e1-4322-b2d4-779037eff32c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:6e:78', 'vm-uuid': '3a4f27f3-4573-43b5-827a-bbdae4ebce10'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:03:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:07 user nova-compute[72815]: INFO os_vif [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48')
Aug 17 20:03:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-aa1fea19-4b40-49ac-ad95-8389d8f99954 req-2ce65164-c7fe-47d0-a4ba-a9887b765942 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-aa1fea19-4b40-49ac-ad95-8389d8f99954 req-2ce65164-c7fe-47d0-a4ba-a9887b765942 service nova] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-aa1fea19-4b40-49ac-ad95-8389d8f99954 req-2ce65164-c7fe-47d0-a4ba-a9887b765942 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-aa1fea19-4b40-49ac-ad95-8389d8f99954 req-2ce65164-c7fe-47d0-a4ba-a9887b765942 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-aa1fea19-4b40-49ac-ad95-8389d8f99954 req-2ce65164-c7fe-47d0-a4ba-a9887b765942 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] No waiting events found dispatching network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:03:09 user nova-compute[72815]: WARNING nova.compute.manager [req-aa1fea19-4b40-49ac-ad95-8389d8f99954 req-2ce65164-c7fe-47d0-a4ba-a9887b765942 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received unexpected event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c for instance with vm_state resized and task_state resize_reverting.
Aug 17 20:03:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:11 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302591.3727214, 3a4f27f3-4573-43b5-827a-bbdae4ebce10 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:03:11 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] VM Resumed (Lifecycle Event)
Aug 17 20:03:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:03:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Instance running successfully.
Aug 17 20:03:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] finish_revert_migration finished successfully. {{(pid=72815) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 17 20:03:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:03:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:03:11 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 20:03:11 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302591.3738573, 3a4f27f3-4573-43b5-827a-bbdae4ebce10 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:03:11 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] VM Started (Lifecycle Event)
Aug 17 20:03:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:03:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:03:11 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 20:03:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-df9bfdce-19e3-4adc-998a-b5aa2a916071 req-cbd4abaf-65d0-49ad-a699-f073dac1051d service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-df9bfdce-19e3-4adc-998a-b5aa2a916071 req-cbd4abaf-65d0-49ad-a699-f073dac1051d service nova] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-df9bfdce-19e3-4adc-998a-b5aa2a916071 req-cbd4abaf-65d0-49ad-a699-f073dac1051d service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-df9bfdce-19e3-4adc-998a-b5aa2a916071 req-cbd4abaf-65d0-49ad-a699-f073dac1051d service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-df9bfdce-19e3-4adc-998a-b5aa2a916071 req-cbd4abaf-65d0-49ad-a699-f073dac1051d service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] No waiting events found dispatching network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:03:11 user nova-compute[72815]: WARNING nova.compute.manager [req-df9bfdce-19e3-4adc-998a-b5aa2a916071 req-cbd4abaf-65d0-49ad-a699-f073dac1051d service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received unexpected event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c for instance with vm_state resized and task_state resize_reverting.
Aug 17 20:03:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:11 user nova-compute[72815]: INFO nova.compute.manager [None req-2a34e3a2-8da6-4b48-8a0c-2f375a386ca9 tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating instance to original state: 'active'
Aug 17 20:03:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:14 user nova-compute[72815]: INFO nova.compute.manager [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Terminating instance
Aug 17 20:03:14 user nova-compute[72815]: DEBUG nova.compute.manager [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:03:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-2d29a327-27ba-40a4-ab6f-968e81c7b7ad req-91c75051-fc07-4a58-9fed-1811646e4f6e service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received event network-vif-unplugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2d29a327-27ba-40a4-ab6f-968e81c7b7ad req-91c75051-fc07-4a58-9fed-1811646e4f6e service nova] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2d29a327-27ba-40a4-ab6f-968e81c7b7ad req-91c75051-fc07-4a58-9fed-1811646e4f6e service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2d29a327-27ba-40a4-ab6f-968e81c7b7ad req-91c75051-fc07-4a58-9fed-1811646e4f6e service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-2d29a327-27ba-40a4-ab6f-968e81c7b7ad req-91c75051-fc07-4a58-9fed-1811646e4f6e service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] No waiting events found dispatching network-vif-unplugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-2d29a327-27ba-40a4-ab6f-968e81c7b7ad req-91c75051-fc07-4a58-9fed-1811646e4f6e service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received event network-vif-unplugged-8efa8696-1a0f-42c7-a009-0700e77b8923 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:15 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Instance destroyed successfully.
Aug 17 20:03:15 user nova-compute[72815]: DEBUG nova.objects.instance [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'resources' on Instance uuid fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T19:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1853215392',display_name='tempest-ServerActionsTestOtherA-server-1223347787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1853215392',id=16,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDN+itvlDzHBO+C0L5CdVVjN9zLYJQZyVMxIHI48MdeloXzEtFXvxcRexB54et5sFgI02m27W5UFXQX0FgRie2BIaKjkATT3pAVtNYbH9Q9MC8QkDr8EAwxg7wvp+8x62Q==',key_name='tempest-keypair-1413124709',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:59:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-06lrf0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:00:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "8efa8696-1a0f-42c7-a009-0700e77b8923", "address": "fa:16:3e:e8:55:36", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efa8696-1a", "ovs_interfaceid": "8efa8696-1a0f-42c7-a009-0700e77b8923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG os_vif [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8efa8696-1a, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:15 user nova-compute[72815]: INFO os_vif [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:55:36,bridge_name='br-int',has_traffic_filtering=True,id=8efa8696-1a0f-42c7-a009-0700e77b8923,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efa8696-1a')
Aug 17 20:03:15 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Deleting instance files /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0_del
Aug 17 20:03:15 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Deletion of /opt/stack/data/nova/instances/fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0_del complete
Aug 17 20:03:15 user nova-compute[72815]: INFO nova.compute.manager [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 20:03:15 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:03:15 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:03:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:16 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:03:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-f1032cf1-1893-4de3-b508-01e319284625 req-db1e2613-5983-4ca2-a741-1c60dd49cc91 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received event network-vif-deleted-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:16 user nova-compute[72815]: INFO nova.compute.manager [req-f1032cf1-1893-4de3-b508-01e319284625 req-db1e2613-5983-4ca2-a741-1c60dd49cc91 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Neutron deleted interface 8efa8696-1a0f-42c7-a009-0700e77b8923; detaching it from the instance and deleting it from the info cache
Aug 17 20:03:16 user nova-compute[72815]: DEBUG nova.network.neutron [req-f1032cf1-1893-4de3-b508-01e319284625 req-db1e2613-5983-4ca2-a741-1c60dd49cc91 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:03:16 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Took 0.93 seconds to deallocate network for instance.
Aug 17 20:03:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-f1032cf1-1893-4de3-b508-01e319284625 req-db1e2613-5983-4ca2-a741-1c60dd49cc91 service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Detach interface failed, port_id=8efa8696-1a0f-42c7-a009-0700e77b8923, reason: Instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:03:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:17 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:03:17 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:03:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.514s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-b44c5fbf-3d02-4baa-8864-448d10e91891 req-97a85750-085a-4c6e-a315-bff297201aaf service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received event network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b44c5fbf-3d02-4baa-8864-448d10e91891 req-97a85750-085a-4c6e-a315-bff297201aaf service nova] Acquiring lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b44c5fbf-3d02-4baa-8864-448d10e91891 req-97a85750-085a-4c6e-a315-bff297201aaf service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b44c5fbf-3d02-4baa-8864-448d10e91891 req-97a85750-085a-4c6e-a315-bff297201aaf service nova] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-b44c5fbf-3d02-4baa-8864-448d10e91891 req-97a85750-085a-4c6e-a315-bff297201aaf service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] No waiting events found dispatching network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:03:17 user nova-compute[72815]: WARNING nova.compute.manager [req-b44c5fbf-3d02-4baa-8864-448d10e91891 req-97a85750-085a-4c6e-a315-bff297201aaf service nova] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Received unexpected event network-vif-plugged-8efa8696-1a0f-42c7-a009-0700e77b8923 for instance with vm_state deleted and task_state None.
Aug 17 20:03:17 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Deleted allocations for instance fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0
Aug 17 20:03:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-71c5ea6b-68fb-48ce-bf5d-945c1bd2eaa6 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.610s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:26 user nova-compute[72815]: INFO nova.compute.manager [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Terminating instance
Aug 17 20:03:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-4da6c587-57d4-4e68-ac4a-0c2350a0097c req-c6b0f338-7038-4f89-9111-4a49334ada34 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-unplugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4da6c587-57d4-4e68-ac4a-0c2350a0097c req-c6b0f338-7038-4f89-9111-4a49334ada34 service nova] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4da6c587-57d4-4e68-ac4a-0c2350a0097c req-c6b0f338-7038-4f89-9111-4a49334ada34 service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4da6c587-57d4-4e68-ac4a-0c2350a0097c req-c6b0f338-7038-4f89-9111-4a49334ada34 service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-4da6c587-57d4-4e68-ac4a-0c2350a0097c req-c6b0f338-7038-4f89-9111-4a49334ada34 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] No waiting events found dispatching network-vif-unplugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:03:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-4da6c587-57d4-4e68-ac4a-0c2350a0097c req-c6b0f338-7038-4f89-9111-4a49334ada34 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-unplugged-7d010d95-173c-44df-be70-170e3ca59b0e for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:03:27 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Instance destroyed successfully.
Aug 17 20:03:27 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'resources' on Instance uuid 1800ab7b-dd88-45fb-9370-1b77b8cbf893 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643279889',display_name='tempest-AttachVolumeTestJSON-server-643279889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643279889',id=5,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESF266QwfIKeTik8wnoygIiOf2r6BrCWxIIzDojrbBZKm/zXPBtL9YHLKhpKFS8eHXyHAtcWfIKVJD6LLHKDkJll+G0nOWdMGtF8im19Z7tm6u5x2HPboD1YjRBA8g36A==',key_name='tempest-keypair-447370262',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:53:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb016b8ab299475e9f916809c7b55182',ramdisk_id='',reservation_id='r-0ehl5jun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1462912324',owner_user_name='tempest-AttachVolumeTestJSON-1462912324-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c894534b34d943229dc89f6d58836acb',uuid=1800ab7b-dd88-45fb-9370-1b77b8cbf893,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converting VIF {"id": "7d010d95-173c-44df-be70-170e3ca59b0e", "address": "fa:16:3e:ef:cb:33", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d010d95-17", "ovs_interfaceid": "7d010d95-173c-44df-be70-170e3ca59b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG os_vif [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d010d95-17, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:27 user nova-compute[72815]: INFO os_vif [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:cb:33,bridge_name='br-int',has_traffic_filtering=True,id=7d010d95-173c-44df-be70-170e3ca59b0e,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d010d95-17')
Aug 17 20:03:27 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Deleting instance files /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893_del
Aug 17 20:03:27 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Deletion of /opt/stack/data/nova/instances/1800ab7b-dd88-45fb-9370-1b77b8cbf893_del complete
Aug 17 20:03:27 user nova-compute[72815]: INFO nova.compute.manager [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 17 20:03:27 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:27 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:03:27 user nova-compute[72815]: INFO nova.compute.claims [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Claim successful on node user
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:03:28 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:03:28 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Took 1.00 seconds to deallocate network for instance.
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-88e42d20-a5f7-4cbb-a32d-7f0b9ea254e9 req-b7202b86-b90d-4af0-8260-76546fd1eb1e service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-deleted-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:28 user nova-compute[72815]: INFO nova.compute.manager [req-88e42d20-a5f7-4cbb-a32d-7f0b9ea254e9 req-b7202b86-b90d-4af0-8260-76546fd1eb1e service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Neutron deleted interface 7d010d95-173c-44df-be70-170e3ca59b0e; detaching it from the instance and deleting it from the info cache
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.network.neutron [req-88e42d20-a5f7-4cbb-a32d-7f0b9ea254e9 req-b7202b86-b90d-4af0-8260-76546fd1eb1e service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-88e42d20-a5f7-4cbb-a32d-7f0b9ea254e9 req-b7202b86-b90d-4af0-8260-76546fd1eb1e service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Detach interface failed, port_id=7d010d95-173c-44df-be70-170e3ca59b0e, reason: Instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.policy [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a75e05392d54cfb9fcda786e3ee2efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9b4cae7404f3184fc480ffddfbbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:03:28 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Creating image(s)
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "/opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "/opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "/opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.211s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-c6df34ac-e6af-4d81-9472-a412e54a4a97 req-b7c58533-aba3-4dff-ad4f-196c000fd600 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c6df34ac-e6af-4d81-9472-a412e54a4a97 req-b7c58533-aba3-4dff-ad4f-196c000fd600 service nova] Acquiring lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c6df34ac-e6af-4d81-9472-a412e54a4a97 req-b7c58533-aba3-4dff-ad4f-196c000fd600 service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c6df34ac-e6af-4d81-9472-a412e54a4a97 req-b7c58533-aba3-4dff-ad4f-196c000fd600 service nova] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-c6df34ac-e6af-4d81-9472-a412e54a4a97 req-b7c58533-aba3-4dff-ad4f-196c000fd600 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] No waiting events found dispatching network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:03:28 user nova-compute[72815]: WARNING nova.compute.manager [req-c6df34ac-e6af-4d81-9472-a412e54a4a97 req-b7c58533-aba3-4dff-ad4f-196c000fd600 service nova] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Received unexpected event network-vif-plugged-7d010d95-173c-44df-be70-170e3ca59b0e for instance with vm_state deleted and task_state None.
Aug 17 20:03:28 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.205s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.553s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk 1073741824" returned: 0 in 0.055s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:29 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Deleted allocations for instance 1800ab7b-dd88-45fb-9370-1b77b8cbf893
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f749a2ca-3197-406c-9743-8d395448e6f4 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "1800ab7b-dd88-45fb-9370-1b77b8cbf893" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.728s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Successfully created port: 28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.213s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Cannot resize image /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'migration_context' on Instance uuid 72c9428f-f797-46b4-9780-d2a4abb01ae7 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Ensure instance console log exists: /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302595.5168467, fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:03:30 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] VM Stopped (Lifecycle Event)
Aug 17 20:03:30 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1a2bc4d0-125e-450f-a2c4-531d745cb848 None None] [instance: fdfa0017-5ec3-46a4-8eb8-3b9ef87fc7f0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Successfully updated port: 28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-63a33250-7a02-408a-8b2c-6b0d0c9c3609 req-15964e18-3747-4804-9e8b-c59a2f0aea3e service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Received event network-changed-28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-63a33250-7a02-408a-8b2c-6b0d0c9c3609 req-15964e18-3747-4804-9e8b-c59a2f0aea3e service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Refreshing instance network info cache due to event network-changed-28cbd6c4-08ff-4d40-ac71-f26a0b61457d. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-63a33250-7a02-408a-8b2c-6b0d0c9c3609 req-15964e18-3747-4804-9e8b-c59a2f0aea3e service nova] Acquiring lock "refresh_cache-72c9428f-f797-46b4-9780-d2a4abb01ae7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-63a33250-7a02-408a-8b2c-6b0d0c9c3609 req-15964e18-3747-4804-9e8b-c59a2f0aea3e service nova] Acquired lock "refresh_cache-72c9428f-f797-46b4-9780-d2a4abb01ae7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG nova.network.neutron [req-63a33250-7a02-408a-8b2c-6b0d0c9c3609 req-15964e18-3747-4804-9e8b-c59a2f0aea3e service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Refreshing network info cache for port 28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "refresh_cache-72c9428f-f797-46b4-9780-d2a4abb01ae7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG nova.network.neutron [req-63a33250-7a02-408a-8b2c-6b0d0c9c3609 req-15964e18-3747-4804-9e8b-c59a2f0aea3e service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.network.neutron [req-63a33250-7a02-408a-8b2c-6b0d0c9c3609 req-15964e18-3747-4804-9e8b-c59a2f0aea3e service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-63a33250-7a02-408a-8b2c-6b0d0c9c3609 req-15964e18-3747-4804-9e8b-c59a2f0aea3e service nova] Releasing lock "refresh_cache-72c9428f-f797-46b4-9780-d2a4abb01ae7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquired lock "refresh_cache-72c9428f-f797-46b4-9780-d2a4abb01ae7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.network.neutron [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Updating instance_info_cache with network_info: [{"id": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "address": "fa:16:3e:ba:2a:d7", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbd6c4-08", "ovs_interfaceid": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Releasing lock "refresh_cache-72c9428f-f797-46b4-9780-d2a4abb01ae7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Instance network_info: |[{"id": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "address": "fa:16:3e:ba:2a:d7", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbd6c4-08", "ovs_interfaceid": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Start _get_guest_xml network_info=[{"id": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "address": "fa:16:3e:ba:2a:d7", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbd6c4-08", "ovs_interfaceid": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:03:31 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:03:31 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-857873287',display_name='tempest-AttachVolumeNegativeTest-server-857873287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-857873287',id=25,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUyELm0xEBtJuFozQY4UX3vPr3efF6Imhcj1qxiDC/pA+gqxrHbYk3vvgTNi17YRu9YiDg+Qrau4mlrCgRG0FjBMB+vy8aZVbjgiE0u0p4xkBxnWmhMO01H7oTiWPCRuA==',key_name='tempest-keypair-1747713663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ee9b4cae7404f3184fc480ffddfbbcd',ramdisk_id='',reservation_id='r-lm6171z3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1950293532',owner_user_name='tempest-AttachVolumeNegativeTest-1950293532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a75e05392d54cfb9fcda786e3ee2efc',uuid=72c9428f-f797-46b4-9780-d2a4abb01ae7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "address": "fa:16:3e:ba:2a:d7", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbd6c4-08", "ovs_interfaceid": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converting VIF {"id": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "address": "fa:16:3e:ba:2a:d7", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbd6c4-08", "ovs_interfaceid": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:2a:d7,bridge_name='br-int',has_traffic_filtering=True,id=28cbd6c4-08ff-4d40-ac71-f26a0b61457d,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbd6c4-08') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'pci_devices' on Instance uuid 72c9428f-f797-46b4-9780-d2a4abb01ae7 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:03:31 user nova-compute[72815]:   <uuid>72c9428f-f797-46b4-9780-d2a4abb01ae7</uuid>
Aug 17 20:03:31 user nova-compute[72815]:   <name>instance-00000019</name>
Aug 17 20:03:31 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:03:31 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:03:31 user nova-compute[72815]:   <metadata>
Aug 17 20:03:31 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:03:31 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:03:31 user nova-compute[72815]:       <nova:name>tempest-AttachVolumeNegativeTest-server-857873287</nova:name>
Aug 17 20:03:31 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:03:31</nova:creationTime>
Aug 17 20:03:31 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:03:31 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:03:31 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:03:31 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:03:31 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:03:31 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:03:31 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:03:31 user nova-compute[72815]:       <nova:owner>
Aug 17 20:03:31 user nova-compute[72815]:         <nova:user uuid="2a75e05392d54cfb9fcda786e3ee2efc">tempest-AttachVolumeNegativeTest-1950293532-project-member</nova:user>
Aug 17 20:03:31 user nova-compute[72815]:         <nova:project uuid="9ee9b4cae7404f3184fc480ffddfbbcd">tempest-AttachVolumeNegativeTest-1950293532</nova:project>
Aug 17 20:03:31 user nova-compute[72815]:       </nova:owner>
Aug 17 20:03:31 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:03:31 user nova-compute[72815]:       <nova:ports>
Aug 17 20:03:31 user nova-compute[72815]:         <nova:port uuid="28cbd6c4-08ff-4d40-ac71-f26a0b61457d">
Aug 17 20:03:31 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 20:03:31 user nova-compute[72815]:         </nova:port>
Aug 17 20:03:31 user nova-compute[72815]:       </nova:ports>
Aug 17 20:03:31 user nova-compute[72815]:     </nova:instance>
Aug 17 20:03:31 user nova-compute[72815]:   </metadata>
Aug 17 20:03:31 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:03:31 user nova-compute[72815]:     <system>
Aug 17 20:03:31 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:03:31 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:03:31 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:03:31 user nova-compute[72815]:       <entry name="serial">72c9428f-f797-46b4-9780-d2a4abb01ae7</entry>
Aug 17 20:03:31 user nova-compute[72815]:       <entry name="uuid">72c9428f-f797-46b4-9780-d2a4abb01ae7</entry>
Aug 17 20:03:31 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:03:31 user nova-compute[72815]:     </system>
Aug 17 20:03:31 user nova-compute[72815]:   </sysinfo>
Aug 17 20:03:31 user nova-compute[72815]:   <os>
Aug 17 20:03:31 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:03:31 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:03:31 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:03:31 user nova-compute[72815]:   </os>
Aug 17 20:03:31 user nova-compute[72815]:   <features>
Aug 17 20:03:31 user nova-compute[72815]:     <acpi/>
Aug 17 20:03:31 user nova-compute[72815]:     <apic/>
Aug 17 20:03:31 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:03:31 user nova-compute[72815]:   </features>
Aug 17 20:03:31 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:03:31 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:03:31 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:03:31 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:03:31 user nova-compute[72815]:   </clock>
Aug 17 20:03:31 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:03:31 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:03:31 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:03:31 user nova-compute[72815]:   </cpu>
Aug 17 20:03:31 user nova-compute[72815]:   <devices>
Aug 17 20:03:31 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:03:31 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:03:31 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk"/>
Aug 17 20:03:31 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:03:31 user nova-compute[72815]:     </disk>
Aug 17 20:03:31 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:03:31 user nova-compute[72815]:       <mac address="fa:16:3e:ba:2a:d7"/>
Aug 17 20:03:31 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:03:31 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:03:31 user nova-compute[72815]:       <target dev="tap28cbd6c4-08"/>
Aug 17 20:03:31 user nova-compute[72815]:     </interface>
Aug 17 20:03:31 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:03:31 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/console.log" append="off"/>
Aug 17 20:03:31 user nova-compute[72815]:     </serial>
Aug 17 20:03:31 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:03:31 user nova-compute[72815]:     <video>
Aug 17 20:03:31 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:03:31 user nova-compute[72815]:     </video>
Aug 17 20:03:31 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:03:31 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:03:31 user nova-compute[72815]:     </rng>
Aug 17 20:03:31 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:03:31 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:03:31 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:03:31 user nova-compute[72815]:     </memballoon>
Aug 17 20:03:31 user nova-compute[72815]:   </devices>
Aug 17 20:03:31 user nova-compute[72815]: </domain>
Aug 17 20:03:31 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-857873287',display_name='tempest-AttachVolumeNegativeTest-server-857873287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-857873287',id=25,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUyELm0xEBtJuFozQY4UX3vPr3efF6Imhcj1qxiDC/pA+gqxrHbYk3vvgTNi17YRu9YiDg+Qrau4mlrCgRG0FjBMB+vy8aZVbjgiE0u0p4xkBxnWmhMO01H7oTiWPCRuA==',key_name='tempest-keypair-1747713663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ee9b4cae7404f3184fc480ffddfbbcd',ramdisk_id='',reservation_id='r-lm6171z3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1950293532',owner_user_name='tempest-AttachVolumeNegativeTest-1950293532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a75e05392d54cfb9fcda786e3ee2efc',uuid=72c9428f-f797-46b4-9780-d2a4abb01ae7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "address": "fa:16:3e:ba:2a:d7", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbd6c4-08", "ovs_interfaceid": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converting VIF {"id": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "address": "fa:16:3e:ba:2a:d7", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbd6c4-08", "ovs_interfaceid": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:2a:d7,bridge_name='br-int',has_traffic_filtering=True,id=28cbd6c4-08ff-4d40-ac71-f26a0b61457d,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbd6c4-08') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG os_vif [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:2a:d7,bridge_name='br-int',has_traffic_filtering=True,id=28cbd6c4-08ff-4d40-ac71-f26a0b61457d,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbd6c4-08') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28cbd6c4-08, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28cbd6c4-08, col_values=(('external_ids', {'iface-id': '28cbd6c4-08ff-4d40-ac71-f26a0b61457d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:2a:d7', 'vm-uuid': '72c9428f-f797-46b4-9780-d2a4abb01ae7'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:31 user nova-compute[72815]: INFO os_vif [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:2a:d7,bridge_name='br-int',has_traffic_filtering=True,id=28cbd6c4-08ff-4d40-ac71-f26a0b61457d,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbd6c4-08')
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No VIF found with MAC fa:16:3e:ba:2a:d7, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-b6117c8b-3efa-4ff3-aa96-b32c032aea2b req-6abf17bc-28c8-4b93-a37a-5a59ec2d4dce service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Received event network-vif-plugged-28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b6117c8b-3efa-4ff3-aa96-b32c032aea2b req-6abf17bc-28c8-4b93-a37a-5a59ec2d4dce service nova] Acquiring lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b6117c8b-3efa-4ff3-aa96-b32c032aea2b req-6abf17bc-28c8-4b93-a37a-5a59ec2d4dce service nova] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b6117c8b-3efa-4ff3-aa96-b32c032aea2b req-6abf17bc-28c8-4b93-a37a-5a59ec2d4dce service nova] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-b6117c8b-3efa-4ff3-aa96-b32c032aea2b req-6abf17bc-28c8-4b93-a37a-5a59ec2d4dce service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] No waiting events found dispatching network-vif-plugged-28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:03:33 user nova-compute[72815]: WARNING nova.compute.manager [req-b6117c8b-3efa-4ff3-aa96-b32c032aea2b req-6abf17bc-28c8-4b93-a37a-5a59ec2d4dce service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Received unexpected event network-vif-plugged-28cbd6c4-08ff-4d40-ac71-f26a0b61457d for instance with vm_state building and task_state spawning.
Aug 17 20:03:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302615.5678778, 72c9428f-f797-46b4-9780-d2a4abb01ae7 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:03:36 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] VM Resumed (Lifecycle Event)
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.manager [req-be3c7e2b-8d67-43e1-b2f1-0638f7179355 req-31d54ba8-cdd3-4caf-94e4-414be38dc267 service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Received event network-vif-plugged-28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-be3c7e2b-8d67-43e1-b2f1-0638f7179355 req-31d54ba8-cdd3-4caf-94e4-414be38dc267 service nova] Acquiring lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-be3c7e2b-8d67-43e1-b2f1-0638f7179355 req-31d54ba8-cdd3-4caf-94e4-414be38dc267 service nova] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-be3c7e2b-8d67-43e1-b2f1-0638f7179355 req-31d54ba8-cdd3-4caf-94e4-414be38dc267 service nova] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.manager [req-be3c7e2b-8d67-43e1-b2f1-0638f7179355 req-31d54ba8-cdd3-4caf-94e4-414be38dc267 service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] No waiting events found dispatching network-vif-plugged-28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:03:36 user nova-compute[72815]: WARNING nova.compute.manager [req-be3c7e2b-8d67-43e1-b2f1-0638f7179355 req-31d54ba8-cdd3-4caf-94e4-414be38dc267 service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Received unexpected event network-vif-plugged-28cbd6c4-08ff-4d40-ac71-f26a0b61457d for instance with vm_state building and task_state spawning.
Aug 17 20:03:36 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:03:36 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7013MB free_disk=25.33083724975586GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:36 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Instance spawned successfully.
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:03:36 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302615.5695968, 72c9428f-f797-46b4-9780-d2a4abb01ae7 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:03:36 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] VM Started (Lifecycle Event)
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:03:36 user nova-compute[72815]: INFO nova.compute.manager [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Took 7.70 seconds to spawn the instance on the hypervisor.
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:03:36 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 45b6365f-333f-45f1-b619-3453cbe75a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 3a4f27f3-4573-43b5-827a-bbdae4ebce10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 71e8c292-6412-4079-8a2c-11c65c808588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance d45cf87c-d69c-4334-8638-0b92ae395e99 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 12a34846-1670-4c6c-ac7d-522530aaf3a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ee4a8248-9abc-45b3-9bf6-349c4d11f189 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 72c9428f-f797-46b4-9780-d2a4abb01ae7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:03:36 user nova-compute[72815]: INFO nova.compute.manager [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Took 8.64 seconds to build instance.
Aug 17 20:03:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6932c74b-824a-41b5-a830-779901dfd4a6 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.733s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:03:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:38 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:03:38 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:03:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:03:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-72257244-62a3-40be-bc58-4518f65738c0 req-867f4cb2-6177-4b71-932f-cc476647a253 service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Received event network-changed-75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-72257244-62a3-40be-bc58-4518f65738c0 req-867f4cb2-6177-4b71-932f-cc476647a253 service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Refreshing instance network info cache due to event network-changed-75f40a91-a6d6-45b0-8146-b63ed8690498. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:03:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-72257244-62a3-40be-bc58-4518f65738c0 req-867f4cb2-6177-4b71-932f-cc476647a253 service nova] Acquiring lock "refresh_cache-71e8c292-6412-4079-8a2c-11c65c808588" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:03:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-72257244-62a3-40be-bc58-4518f65738c0 req-867f4cb2-6177-4b71-932f-cc476647a253 service nova] Acquired lock "refresh_cache-71e8c292-6412-4079-8a2c-11c65c808588" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:03:38 user nova-compute[72815]: DEBUG nova.network.neutron [req-72257244-62a3-40be-bc58-4518f65738c0 req-867f4cb2-6177-4b71-932f-cc476647a253 service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Refreshing network info cache for port 75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG nova.network.neutron [req-72257244-62a3-40be-bc58-4518f65738c0 req-867f4cb2-6177-4b71-932f-cc476647a253 service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Updated VIF entry in instance network info cache for port 75f40a91-a6d6-45b0-8146-b63ed8690498. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG nova.network.neutron [req-72257244-62a3-40be-bc58-4518f65738c0 req-867f4cb2-6177-4b71-932f-cc476647a253 service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Updating instance_info_cache with network_info: [{"id": "75f40a91-a6d6-45b0-8146-b63ed8690498", "address": "fa:16:3e:9d:8b:8a", "network": {"id": "4d7c633c-edae-419d-823d-f83bfc69b641", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1851083827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520c959f1a5480293b0c8f501da0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f40a91-a6", "ovs_interfaceid": "75f40a91-a6d6-45b0-8146-b63ed8690498", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-72257244-62a3-40be-bc58-4518f65738c0 req-867f4cb2-6177-4b71-932f-cc476647a253 service nova] Releasing lock "refresh_cache-71e8c292-6412-4079-8a2c-11c65c808588" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG nova.objects.instance [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lazy-loading 'flavor' on Instance uuid 71e8c292-6412-4079-8a2c-11c65c808588 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Updating instance_info_cache with network_info: [{"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:03:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:40 user nova-compute[72815]: INFO nova.compute.manager [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Attaching volume 70e9419b-ebd2-488a-be00-47ecf55e0dc1 to /dev/vdb
Aug 17 20:03:40 user nova-compute[72815]: DEBUG os_brick.utils [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09bc3cf-fe83-4be2-aee7-e7e5e860f2ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f028fcd7-722a-473c-a75b-867bebec261d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d3bb30-6af4-4873-84a7-302f3f0d2b8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72a1163-1b9d-4106-8c3b-c68248ab9083]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:03:40 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:03:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[952d5d65-46fd-43db-bfab-a5c38d1f06d0]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG os_brick.utils [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:03:40 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Updating existing volume attachment record: 098a6155-a6c5-4ee1-beb7-75bfe2020fcc {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:03:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:42 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302607.3280728, 1800ab7b-dd88-45fb-9370-1b77b8cbf893 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:03:42 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] VM Stopped (Lifecycle Event)
Aug 17 20:03:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-696ec8f1-3146-4d0c-99a5-9f2f182287a6 None None] [instance: 1800ab7b-dd88-45fb-9370-1b77b8cbf893] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:03:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-8087296b-af5e-45e1-9eb9-f08c0baac8a3 req-15078918-ecc8-4457-90e8-796771f8504e service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Received event network-changed-14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-8087296b-af5e-45e1-9eb9-f08c0baac8a3 req-15078918-ecc8-4457-90e8-796771f8504e service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Refreshing instance network info cache due to event network-changed-14230629-a60c-41b1-a7ba-bed70d03d123. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8087296b-af5e-45e1-9eb9-f08c0baac8a3 req-15078918-ecc8-4457-90e8-796771f8504e service nova] Acquiring lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8087296b-af5e-45e1-9eb9-f08c0baac8a3 req-15078918-ecc8-4457-90e8-796771f8504e service nova] Acquired lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG nova.network.neutron [req-8087296b-af5e-45e1-9eb9-f08c0baac8a3 req-15078918-ecc8-4457-90e8-796771f8504e service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Refreshing network info cache for port 14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "45b6365f-333f-45f1-b619-3453cbe75a88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "45b6365f-333f-45f1-b619-3453cbe75a88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:44 user nova-compute[72815]: INFO nova.compute.manager [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Terminating instance
Aug 17 20:03:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-a53c2bc8-35c8-423f-b632-42d08877c29f req-9bd90ab2-3b5b-49cc-9c12-7b2a6116a96e service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Received event network-vif-unplugged-14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a53c2bc8-35c8-423f-b632-42d08877c29f req-9bd90ab2-3b5b-49cc-9c12-7b2a6116a96e service nova] Acquiring lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a53c2bc8-35c8-423f-b632-42d08877c29f req-9bd90ab2-3b5b-49cc-9c12-7b2a6116a96e service nova] Lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a53c2bc8-35c8-423f-b632-42d08877c29f req-9bd90ab2-3b5b-49cc-9c12-7b2a6116a96e service nova] Lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-a53c2bc8-35c8-423f-b632-42d08877c29f req-9bd90ab2-3b5b-49cc-9c12-7b2a6116a96e service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] No waiting events found dispatching network-vif-unplugged-14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-a53c2bc8-35c8-423f-b632-42d08877c29f req-9bd90ab2-3b5b-49cc-9c12-7b2a6116a96e service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Received event network-vif-unplugged-14230629-a60c-41b1-a7ba-bed70d03d123 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG nova.network.neutron [req-8087296b-af5e-45e1-9eb9-f08c0baac8a3 req-15078918-ecc8-4457-90e8-796771f8504e service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Updated VIF entry in instance network info cache for port 14230629-a60c-41b1-a7ba-bed70d03d123. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG nova.network.neutron [req-8087296b-af5e-45e1-9eb9-f08c0baac8a3 req-15078918-ecc8-4457-90e8-796771f8504e service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Updating instance_info_cache with network_info: [{"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8087296b-af5e-45e1-9eb9-f08c0baac8a3 req-15078918-ecc8-4457-90e8-796771f8504e service nova] Releasing lock "refresh_cache-45b6365f-333f-45f1-b619-3453cbe75a88" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:03:45 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Instance destroyed successfully.
Aug 17 20:03:45 user nova-compute[72815]: DEBUG nova.objects.instance [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lazy-loading 'resources' on Instance uuid 45b6365f-333f-45f1-b619-3453cbe75a88 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1845893949',display_name='tempest-TestStampPattern-server-1845893949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1845893949',id=11,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqC6RUkKN1taHh2Rn8c1allkbJ0/yuwdo3QXAdudNtPlH8PHi5tBUQIsWAsylFF7ZKs0Ps3Kru7ooqRhdzKKP021tMxib7YsWN4dc0onmkUhJNvpAEEo06cjY/saqY+9Q==',key_name='tempest-TestStampPattern-190535839',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:56:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dddf9ff8534e4c1c8afc48c9d02fefcb',ramdisk_id='',reservation_id='r-l0nuu05l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1204244634',owner_user_name='tempest-TestStampPattern-1204244634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:59:27Z,user_data=None,user_id='190c2e4fdf3e49c3a760e332ab09baf3',uuid=45b6365f-333f-45f1-b619-3453cbe75a88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Converting VIF {"id": "14230629-a60c-41b1-a7ba-bed70d03d123", "address": "fa:16:3e:63:03:8c", "network": {"id": "4d655168-3130-47f1-9ec5-7a0ef7b86c73", "bridge": "br-int", "label": "tempest-TestStampPattern-1148804732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddf9ff8534e4c1c8afc48c9d02fefcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14230629-a6", "ovs_interfaceid": "14230629-a60c-41b1-a7ba-bed70d03d123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=14230629-a60c-41b1-a7ba-bed70d03d123,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14230629-a6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG os_vif [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=14230629-a60c-41b1-a7ba-bed70d03d123,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14230629-a6') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14230629-a6, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:03:45 user nova-compute[72815]: INFO os_vif [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=14230629-a60c-41b1-a7ba-bed70d03d123,network=Network(4d655168-3130-47f1-9ec5-7a0ef7b86c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14230629-a6')
Aug 17 20:03:45 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Deleting instance files /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88_del
Aug 17 20:03:45 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Deletion of /opt/stack/data/nova/instances/45b6365f-333f-45f1-b619-3453cbe75a88_del complete
Aug 17 20:03:45 user nova-compute[72815]: INFO nova.compute.manager [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 17 20:03:45 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:03:45 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:03:45 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Took 0.58 seconds to deallocate network for instance.
Aug 17 20:03:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:46 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:03:46 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:03:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:46 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Deleted allocations for instance 45b6365f-333f-45f1-b619-3453cbe75a88
Aug 17 20:03:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-34652104-2a3d-4ad6-8af8-0ad8821ca8eb tempest-TestStampPattern-1204244634 tempest-TestStampPattern-1204244634-project-member] Lock "45b6365f-333f-45f1-b619-3453cbe75a88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.308s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-d527036b-3caf-429f-a058-80d0bb24becf req-b9f32d39-8292-4cb8-989d-94a40d8860e1 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Received event network-vif-plugged-14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d527036b-3caf-429f-a058-80d0bb24becf req-b9f32d39-8292-4cb8-989d-94a40d8860e1 service nova] Acquiring lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d527036b-3caf-429f-a058-80d0bb24becf req-b9f32d39-8292-4cb8-989d-94a40d8860e1 service nova] Lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d527036b-3caf-429f-a058-80d0bb24becf req-b9f32d39-8292-4cb8-989d-94a40d8860e1 service nova] Lock "45b6365f-333f-45f1-b619-3453cbe75a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-d527036b-3caf-429f-a058-80d0bb24becf req-b9f32d39-8292-4cb8-989d-94a40d8860e1 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] No waiting events found dispatching network-vif-plugged-14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:03:47 user nova-compute[72815]: WARNING nova.compute.manager [req-d527036b-3caf-429f-a058-80d0bb24becf req-b9f32d39-8292-4cb8-989d-94a40d8860e1 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Received unexpected event network-vif-plugged-14230629-a60c-41b1-a7ba-bed70d03d123 for instance with vm_state deleted and task_state None.
Aug 17 20:03:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-d527036b-3caf-429f-a058-80d0bb24becf req-b9f32d39-8292-4cb8-989d-94a40d8860e1 service nova] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Received event network-vif-deleted-14230629-a60c-41b1-a7ba-bed70d03d123 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:03:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwPsXcgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:03:53 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:03:53 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:03:53 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[da061522-d9c3-4573-89ed-3808de06652b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:03:53 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f42c86-b0af-425d-be91-42073277f4eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1] added
Aug 17 20:03:53 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[17586f47-0854-4cd0-8ae7-02e3630b5503]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e485de-c73e-4a96-8c34-c47f481962fe]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwPsXcgD {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwPsXcgD" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c69542-1ef3-48f0-90cf-8513374ce304]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nwPsXcgD'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d92d16e-f234-464f-ba90-12017203bb18]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6faa24-0e36-46ab-8a86-8e685572e07a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a970a25-a2de-4baf-be3d-5c8e7b5807e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1, portal: 172.16.0.220,3260]
Aug 17 20:03:53 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1, portal: 172.16.0.220,3260] successful.
Aug 17 20:03:53 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaa9f7f-809c-48c5-b1dc-f9a597cdbebf]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1c5c3f-c4d5-4005-887f-55ca6ede785c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:03:53 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] HCTL ('39', '-', '-', 0) found on session 30 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad61c39-e883-452b-9cff-2373b723f8f7]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:53 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:03:54 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:03:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwPsXcgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:03:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:03:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23163343463306532', 'path': '/dev/sdh'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:03:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163343463306532', 'path': '/dev/sdh'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:03:54 user nova-compute[72815]: DEBUG nova.objects.instance [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lazy-loading 'flavor' on Instance uuid 71e8c292-6412-4079-8a2c-11c65c808588 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:03:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:03:54 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:03:54 user nova-compute[72815]:   <source dev="/dev/sdh"/>
Aug 17 20:03:54 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:03:54 user nova-compute[72815]:   <serial>70e9419b-ebd2-488a-be00-47ecf55e0dc1</serial>
Aug 17 20:03:54 user nova-compute[72815]: </disk>
Aug 17 20:03:54 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:03:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:03:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:03:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] No VIF found with MAC fa:16:3e:9d:8b:8a, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:03:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ddc4ddab-53b6-4f95-9a2d-e6d883e3ffec tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.893s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:03:55 user nova-compute[72815]: INFO nova.compute.manager [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] instance snapshotting
Aug 17 20:03:55 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Beginning live snapshot process
Aug 17 20:03:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json -f qcow2 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json -f qcow2 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:03:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl3_9kt3k/6c9391deb46b493db7797ce87caaca2c.delta 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl3_9kt3k/6c9391deb46b493db7797ce87caaca2c.delta 1073741824" returned: 0 in 0.047s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:56 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 20:03:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 20:03:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 20:03:57 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 20:03:58 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl3_9kt3k/6c9391deb46b493db7797ce87caaca2c.delta /opt/stack/data/nova/instances/snapshots/tmpl3_9kt3k/6c9391deb46b493db7797ce87caaca2c {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lazy-loading 'flavor' on Instance uuid 71e8c292-6412-4079-8a2c-11c65c808588 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl3_9kt3k/6c9391deb46b493db7797ce87caaca2c.delta /opt/stack/data/nova/instances/snapshots/tmpl3_9kt3k/6c9391deb46b493db7797ce87caaca2c" returned: 0 in 0.665s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:58 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Snapshot extracted, beginning image upload
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:03:58 user nova-compute[72815]: INFO nova.compute.manager [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Attaching volume 78aecf70-3051-4f22-b958-ca31d5e07afa to /dev/vdc
Aug 17 20:03:58 user nova-compute[72815]: DEBUG os_brick.utils [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7824ae8-569c-48bd-aef2-d62c7f301751]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[155ed75a-4395-46c5-97ee-e8ecc3294b90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b35e39-84b3-4d85-b931-e285a22f567e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[47968488-2eb2-49e6-ba79-c24161a0d885]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:03:59 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:03:59 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a36e6a2-e896-4141-bc05-afb14ee1f6a1]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG os_brick.utils [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:03:59 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Updating existing volume attachment record: 2eb59b16-4cbc-46d2-9ff2-3830a649706e {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:04:00 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302625.1864948, 45b6365f-333f-45f1-b619-3453cbe75a88 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:04:00 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] VM Stopped (Lifecycle Event)
Aug 17 20:04:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1fa21926-3941-4823-9b8b-c184819f7d4c None None] [instance: 45b6365f-333f-45f1-b619-3453cbe75a88] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:04:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:01 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Snapshot image upload complete
Aug 17 20:04:01 user nova-compute[72815]: INFO nova.compute.manager [None req-37366681-3126-4bc4-a40b-286b3b2146eb tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Took 5.91 seconds to snapshot the instance on the hypervisor.
Aug 17 20:04:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:11 user nova-compute[72815]: INFO nova.compute.manager [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Rescuing
Aug 17 20:04:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:04:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquired lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:04:11 user nova-compute[72815]: DEBUG nova.network.neutron [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:04:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:11 user nova-compute[72815]: DEBUG nova.network.neutron [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Updating instance_info_cache with network_info: [{"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:04:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Releasing lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:04:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-b59cee7b-0e74-4f9a-8a06-3085afeecbe8 req-6ce46cd0-45d5-4f76-8169-e157f5f356dc service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-unplugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b59cee7b-0e74-4f9a-8a06-3085afeecbe8 req-6ce46cd0-45d5-4f76-8169-e157f5f356dc service nova] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b59cee7b-0e74-4f9a-8a06-3085afeecbe8 req-6ce46cd0-45d5-4f76-8169-e157f5f356dc service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b59cee7b-0e74-4f9a-8a06-3085afeecbe8 req-6ce46cd0-45d5-4f76-8169-e157f5f356dc service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-b59cee7b-0e74-4f9a-8a06-3085afeecbe8 req-6ce46cd0-45d5-4f76-8169-e157f5f356dc service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] No waiting events found dispatching network-vif-unplugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:11 user nova-compute[72815]: WARNING nova.compute.manager [req-b59cee7b-0e74-4f9a-8a06-3085afeecbe8 req-6ce46cd0-45d5-4f76-8169-e157f5f356dc service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received unexpected event network-vif-unplugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe for instance with vm_state active and task_state rescuing.
Aug 17 20:04:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKfQwhGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:04:12 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:04:12 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:04:12 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade4c6be-9f8d-4f52-a7b0-2db2736eff83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:04:12 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd289239-ab83-4f5b-ab2e-87ba739e9d2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa] added
Aug 17 20:04:12 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6856dd67-fc00-4014-abc5-33722d19a5e9]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca64a195-764e-4548-b767-a76b4e6c6ba9]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKfQwhGF {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKfQwhGF" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[80456dc4-dbc6-4cc1-8184-582b0637a36f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pKfQwhGF'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[87119eff-df25-41a4-8821-70c2cecc9f9d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[012a8121-db4e-49a6-9c14-fd9ee5f3ae33]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Instance destroyed successfully.
Aug 17 20:04:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Attempting rescue
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72815) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Instance directory exists: not creating {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 20:04:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Creating image(s)
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "/opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "/opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'trusted_certs' on Instance uuid dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dd8675-04d5-41f0-ace9-dcede797e779]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa, portal: 172.16.0.220,3260]
Aug 17 20:04:12 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa, portal: 172.16.0.220,3260] successful.
Aug 17 20:04:12 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4c0360-1b3a-4cab-a08c-bd96114f57d6]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d9d7f4-fb6f-41cb-93e6-49dc1af0f161]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa (non-flash)
Aug 17 20:04:12 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:12 user nova-compute[72815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa (non-flash)
Aug 17 20:04:12 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] HCTL ('40', '-', '-', 0) found on session 31 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c251360c-16df-4d25-9d79-6227627b6e2e]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Searching for a device in session 31 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKfQwhGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.173s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.rescue {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.rescue" returned: 0 in 0.054s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'migration_context' on Instance uuid dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Start _get_guest_xml network_info=[{"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "vif_mac": "fa:16:3e:89:78:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'resources' on Instance uuid dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'numa_topology' on Instance uuid dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:04:12 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:04:12 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'vcpu_model' on Instance uuid dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-999185640',display_name='tempest-ServerRescueNegativeTestJSON-server-999185640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-999185640',id=19,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:59:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6d2cf2910f4d3d9924480d68057b5a',ramdisk_id='',reservation_id='r-srtg51rj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-335799606',owner_user_name='tempest-ServerRescueNegativeTestJSON-335799606-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:59:37Z,user_data=None,user_id='fa27c69e40f243d9b38c87250b5dba5f',uuid=dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "vif_mac": "fa:16:3e:89:78:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converting VIF {"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "vif_mac": "fa:16:3e:89:78:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:78:60,bridge_name='br-int',has_traffic_filtering=True,id=7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7d0039-07') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'pci_devices' on Instance uuid dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:04:12 user nova-compute[72815]:   <uuid>dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2</uuid>
Aug 17 20:04:12 user nova-compute[72815]:   <name>instance-00000013</name>
Aug 17 20:04:12 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:04:12 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:04:12 user nova-compute[72815]:   <metadata>
Aug 17 20:04:12 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:04:12 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:04:12 user nova-compute[72815]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-999185640</nova:name>
Aug 17 20:04:12 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:04:12</nova:creationTime>
Aug 17 20:04:12 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:04:12 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:04:12 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:04:12 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:04:12 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:04:12 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:04:12 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:04:12 user nova-compute[72815]:       <nova:owner>
Aug 17 20:04:12 user nova-compute[72815]:         <nova:user uuid="fa27c69e40f243d9b38c87250b5dba5f">tempest-ServerRescueNegativeTestJSON-335799606-project-member</nova:user>
Aug 17 20:04:12 user nova-compute[72815]:         <nova:project uuid="4e6d2cf2910f4d3d9924480d68057b5a">tempest-ServerRescueNegativeTestJSON-335799606</nova:project>
Aug 17 20:04:12 user nova-compute[72815]:       </nova:owner>
Aug 17 20:04:12 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:04:12 user nova-compute[72815]:       <nova:ports>
Aug 17 20:04:12 user nova-compute[72815]:         <nova:port uuid="7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe">
Aug 17 20:04:12 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 20:04:12 user nova-compute[72815]:         </nova:port>
Aug 17 20:04:12 user nova-compute[72815]:       </nova:ports>
Aug 17 20:04:12 user nova-compute[72815]:     </nova:instance>
Aug 17 20:04:12 user nova-compute[72815]:   </metadata>
Aug 17 20:04:12 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:04:12 user nova-compute[72815]:     <system>
Aug 17 20:04:12 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:04:12 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:04:12 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:04:12 user nova-compute[72815]:       <entry name="serial">dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2</entry>
Aug 17 20:04:12 user nova-compute[72815]:       <entry name="uuid">dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2</entry>
Aug 17 20:04:12 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:04:12 user nova-compute[72815]:     </system>
Aug 17 20:04:12 user nova-compute[72815]:   </sysinfo>
Aug 17 20:04:12 user nova-compute[72815]:   <os>
Aug 17 20:04:12 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:04:12 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:04:12 user nova-compute[72815]:   </os>
Aug 17 20:04:12 user nova-compute[72815]:   <features>
Aug 17 20:04:12 user nova-compute[72815]:     <acpi/>
Aug 17 20:04:12 user nova-compute[72815]:     <apic/>
Aug 17 20:04:12 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:04:12 user nova-compute[72815]:   </features>
Aug 17 20:04:12 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:04:12 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:04:12 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:04:12 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:04:12 user nova-compute[72815]:   </clock>
Aug 17 20:04:12 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:04:12 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:04:12 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:04:12 user nova-compute[72815]:   </cpu>
Aug 17 20:04:12 user nova-compute[72815]:   <devices>
Aug 17 20:04:12 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:04:12 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:04:12 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.rescue"/>
Aug 17 20:04:12 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:04:12 user nova-compute[72815]:     </disk>
Aug 17 20:04:12 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:04:12 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:04:12 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk"/>
Aug 17 20:04:12 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 20:04:12 user nova-compute[72815]:     </disk>
Aug 17 20:04:12 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:04:12 user nova-compute[72815]:       <mac address="fa:16:3e:89:78:60"/>
Aug 17 20:04:12 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:04:12 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:04:12 user nova-compute[72815]:       <target dev="tap7f7d0039-07"/>
Aug 17 20:04:12 user nova-compute[72815]:     </interface>
Aug 17 20:04:12 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:04:12 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/console.log" append="off"/>
Aug 17 20:04:12 user nova-compute[72815]:     </serial>
Aug 17 20:04:12 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:04:12 user nova-compute[72815]:     <video>
Aug 17 20:04:12 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:04:12 user nova-compute[72815]:     </video>
Aug 17 20:04:12 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:04:12 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:04:12 user nova-compute[72815]:     </rng>
Aug 17 20:04:12 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:04:12 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:04:12 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:04:12 user nova-compute[72815]:     </memballoon>
Aug 17 20:04:12 user nova-compute[72815]:   </devices>
Aug 17 20:04:12 user nova-compute[72815]: </domain>
Aug 17 20:04:12 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:04:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Instance destroyed successfully.
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:04:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No VIF found with MAC fa:16:3e:89:78:60, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:04:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:04:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23039623137623464', 'path': '/dev/sdi'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:04:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039623137623464', 'path': '/dev/sdi'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:04:13 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lazy-loading 'flavor' on Instance uuid 71e8c292-6412-4079-8a2c-11c65c808588 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:04:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:04:13 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:04:13 user nova-compute[72815]:   <source dev="/dev/sdi"/>
Aug 17 20:04:13 user nova-compute[72815]:   <target dev="vdc" bus="virtio"/>
Aug 17 20:04:13 user nova-compute[72815]:   <serial>78aecf70-3051-4f22-b958-ca31d5e07afa</serial>
Aug 17 20:04:13 user nova-compute[72815]: </disk>
Aug 17 20:04:13 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:04:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-438fee6e-e709-4425-86e5-ad7b1a98ac03 req-440ae791-3515-4cad-90b9-6f35511b4694 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-438fee6e-e709-4425-86e5-ad7b1a98ac03 req-440ae791-3515-4cad-90b9-6f35511b4694 service nova] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-438fee6e-e709-4425-86e5-ad7b1a98ac03 req-440ae791-3515-4cad-90b9-6f35511b4694 service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-438fee6e-e709-4425-86e5-ad7b1a98ac03 req-440ae791-3515-4cad-90b9-6f35511b4694 service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-438fee6e-e709-4425-86e5-ad7b1a98ac03 req-440ae791-3515-4cad-90b9-6f35511b4694 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] No waiting events found dispatching network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:13 user nova-compute[72815]: WARNING nova.compute.manager [req-438fee6e-e709-4425-86e5-ad7b1a98ac03 req-440ae791-3515-4cad-90b9-6f35511b4694 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received unexpected event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe for instance with vm_state active and task_state rescuing.
Aug 17 20:04:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:04:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:04:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:04:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] No VIF found with MAC fa:16:3e:9d:8b:8a, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:04:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0b76c73c-3027-4c3d-9c9a-d8c3e1ae6fe1 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.355s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:15 user nova-compute[72815]: INFO nova.compute.manager [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Detaching volume 78aecf70-3051-4f22-b958-ca31d5e07afa
Aug 17 20:04:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:15 user nova-compute[72815]: INFO nova.virt.block_device [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Attempting to driver detach volume 78aecf70-3051-4f22-b958-ca31d5e07afa from mountpoint /dev/vdc
Aug 17 20:04:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Attempting to detach device vdc from instance 71e8c292-6412-4079-8a2c-11c65c808588 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:04:15 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:04:15 user nova-compute[72815]:   <source dev="/dev/sdi"/>
Aug 17 20:04:15 user nova-compute[72815]:   <target dev="vdc" bus="virtio"/>
Aug 17 20:04:15 user nova-compute[72815]:   <serial>78aecf70-3051-4f22-b958-ca31d5e07afa</serial>
Aug 17 20:04:15 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 20:04:15 user nova-compute[72815]: </disk>
Aug 17 20:04:15 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:04:15 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Successfully detached device vdc from instance 71e8c292-6412-4079-8a2c-11c65c808588 from the persistent domain config.
Aug 17 20:04:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 71e8c292-6412-4079-8a2c-11c65c808588 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:04:15 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:04:15 user nova-compute[72815]:   <source dev="/dev/sdi"/>
Aug 17 20:04:15 user nova-compute[72815]:   <target dev="vdc" bus="virtio"/>
Aug 17 20:04:15 user nova-compute[72815]:   <serial>78aecf70-3051-4f22-b958-ca31d5e07afa</serial>
Aug 17 20:04:15 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 20:04:15 user nova-compute[72815]: </disk>
Aug 17 20:04:15 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302655.7116413, 71e8c292-6412-4079-8a2c-11c65c808588 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 71e8c292-6412-4079-8a2c-11c65c808588 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:04:15 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Successfully detached device vdc from instance 71e8c292-6412-4079-8a2c-11c65c808588 from the live domain config.
Aug 17 20:04:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKfQwhGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:04:15 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[47879e2f-006b-4cde-801c-f91acb350274]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f60ab5b-dce6-4855-8b14-715ccf194615]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa (non-flash)
Aug 17 20:04:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:15 user nova-compute[72815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa (non-flash)
Aug 17 20:04:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944de9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa'): ({'sdi'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Removing single pathed devices sdi {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[94612716-68f9-4fd0-ac82-db4ae3357772]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a66071-0a4c-4075-b844-0565a58a7b5e]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Flushing IO for device /dev/sdi {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3385a9b2-e239-48f6-98c3-48a8eafc251c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[04322e72-d63d-4e97-944c-c87766b4d9a4]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] SCSI volumes sdi have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baa895f-f885-4360-b1c0-9ff3d8a3320e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef274ac-18c7-44f6-b5ef-90464611766e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa, portal: 172.16.0.220,3260]
Aug 17 20:04:15 user nova-compute[72815]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa, portal: 172.16.0.220,3260] successful.
Aug 17 20:04:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-e7d23eb5-c85e-4c2f-a87e-90d65346d622 req-bb54dc9a-7098-46c6-ae0c-85a5004178ea service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e7d23eb5-c85e-4c2f-a87e-90d65346d622 req-bb54dc9a-7098-46c6-ae0c-85a5004178ea service nova] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e7d23eb5-c85e-4c2f-a87e-90d65346d622 req-bb54dc9a-7098-46c6-ae0c-85a5004178ea service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e7d23eb5-c85e-4c2f-a87e-90d65346d622 req-bb54dc9a-7098-46c6-ae0c-85a5004178ea service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-e7d23eb5-c85e-4c2f-a87e-90d65346d622 req-bb54dc9a-7098-46c6-ae0c-85a5004178ea service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] No waiting events found dispatching network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:16 user nova-compute[72815]: WARNING nova.compute.manager [req-e7d23eb5-c85e-4c2f-a87e-90d65346d622 req-bb54dc9a-7098-46c6-ae0c-85a5004178ea service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received unexpected event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe for instance with vm_state active and task_state rescuing.
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-e7d23eb5-c85e-4c2f-a87e-90d65346d622 req-bb54dc9a-7098-46c6-ae0c-85a5004178ea service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e7d23eb5-c85e-4c2f-a87e-90d65346d622 req-bb54dc9a-7098-46c6-ae0c-85a5004178ea service nova] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e7d23eb5-c85e-4c2f-a87e-90d65346d622 req-bb54dc9a-7098-46c6-ae0c-85a5004178ea service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e7d23eb5-c85e-4c2f-a87e-90d65346d622 req-bb54dc9a-7098-46c6-ae0c-85a5004178ea service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-e7d23eb5-c85e-4c2f-a87e-90d65346d622 req-bb54dc9a-7098-46c6-ae0c-85a5004178ea service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] No waiting events found dispatching network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:16 user nova-compute[72815]: WARNING nova.compute.manager [req-e7d23eb5-c85e-4c2f-a87e-90d65346d622 req-bb54dc9a-7098-46c6-ae0c-85a5004178ea service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received unexpected event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe for instance with vm_state active and task_state rescuing.
Aug 17 20:04:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78aecf70-3051-4f22-b958-ca31d5e07afa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c0bd0b-cd3d-4a97-a0cb-172462c05874]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] <== disconnect_volume: return (315ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302656.62802, dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:04:16 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] VM Resumed (Lifecycle Event)
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-80b9d06f-503c-44ef-a4b7-69430687e7b4 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:04:16 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302656.6298962, dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:04:16 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] VM Started (Lifecycle Event)
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG nova.objects.instance [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lazy-loading 'flavor' on Instance uuid 71e8c292-6412-4079-8a2c-11c65c808588 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:04:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b05c446a-a477-4651-8a8a-6f7d9d265d67 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.688s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:20 user nova-compute[72815]: INFO nova.compute.manager [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Detaching volume a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb
Aug 17 20:04:20 user nova-compute[72815]: INFO nova.virt.block_device [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Attempting to driver detach volume a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb from mountpoint /dev/vdc
Aug 17 20:04:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Attempting to detach device vdc from instance ee4a8248-9abc-45b3-9bf6-349c4d11f189 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:04:20 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:04:20 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 20:04:20 user nova-compute[72815]:   <target dev="vdc" bus="virtio"/>
Aug 17 20:04:20 user nova-compute[72815]:   <serial>a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb</serial>
Aug 17 20:04:20 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 20:04:20 user nova-compute[72815]: </disk>
Aug 17 20:04:20 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:04:20 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Successfully detached device vdc from instance ee4a8248-9abc-45b3-9bf6-349c4d11f189 from the persistent domain config.
Aug 17 20:04:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ee4a8248-9abc-45b3-9bf6-349c4d11f189 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:04:20 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:04:20 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 20:04:20 user nova-compute[72815]:   <target dev="vdc" bus="virtio"/>
Aug 17 20:04:20 user nova-compute[72815]:   <serial>a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb</serial>
Aug 17 20:04:20 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 20:04:20 user nova-compute[72815]: </disk>
Aug 17 20:04:20 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302660.7282984, ee4a8248-9abc-45b3-9bf6-349c4d11f189 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:04:20 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Successfully detached device vdc from instance ee4a8248-9abc-45b3-9bf6-349c4d11f189 from the live domain config.
Aug 17 20:04:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuJzPXSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:04:20 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ce2959-fe60-4721-b54c-9c8a9313aafc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1c99de-f866-4817-b9e0-77526cf219ef]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:20 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:04:20 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:04:20 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:20 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:04:20 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:20 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:20 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:20 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:04:20 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:04:20 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:20 user nova-compute[72815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb (non-flash)
Aug 17 20:04:20 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:20 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:20 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994383be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb'): ({'sdf'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Removing single pathed devices sdf {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be3a79c-cdd1-4fe9-9ac2-be3681f95ae3]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[319c283f-4cd9-466b-8dbe-9370da9b0512]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Flushing IO for device /dev/sdf {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d9b9b3-4d0b-4fde-a82f-3c42cb164af0]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00ad82f-2538-433e-b9b0-f917c0301e61]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[332df811-139e-45b4-be6e-020bc2c6c10e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b77168-b4f6-4bfc-9fba-763397d63291]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb, portal: 172.16.0.220,3260]
Aug 17 20:04:21 user nova-compute[72815]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb, portal: 172.16.0.220,3260] successful.
Aug 17 20:04:21 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a3e8fe-1b13-4da0-8ee3-0095ef9fc9cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fdcb16-8621-4068-bf77-f6d714e9885f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] <== disconnect_volume: return (351ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:21 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:04:21 user nova-compute[72815]: INFO nova.compute.claims [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Claim successful on node user
Aug 17 20:04:21 user nova-compute[72815]: DEBUG nova.objects.instance [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'flavor' on Instance uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e2bc058e-03b6-4f18-80bc-f7c6c47dc713 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.976s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:04:22 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:04:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:04:22 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Creating image(s)
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "/opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "/opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG nova.policy [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c894534b34d943229dc89f6d58836acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb016b8ab299475e9f916809c7b55182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk 1073741824" returned: 0 in 0.050s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.172s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:04:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:23 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Successfully created port: 97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:04:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:23 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Cannot resize image /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:04:23 user nova-compute[72815]: DEBUG nova.objects.instance [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'migration_context' on Instance uuid fa0a87a2-9816-4aed-901d-1dff953f8046 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:04:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:04:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Ensure instance console log exists: /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:04:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Successfully updated port: 97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "refresh_cache-fa0a87a2-9816-4aed-901d-1dff953f8046" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquired lock "refresh_cache-fa0a87a2-9816-4aed-901d-1dff953f8046" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.compute.manager [req-f6f4fe9a-1b76-4261-84f2-d6e1a837f057 req-8cebdde0-0376-4424-9ac2-6645aaf37d10 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-changed-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.compute.manager [req-f6f4fe9a-1b76-4261-84f2-d6e1a837f057 req-8cebdde0-0376-4424-9ac2-6645aaf37d10 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Refreshing instance network info cache due to event network-changed-97b110e2-ceca-4ed9-8886-8d7d2149339f. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f6f4fe9a-1b76-4261-84f2-d6e1a837f057 req-8cebdde0-0376-4424-9ac2-6645aaf37d10 service nova] Acquiring lock "refresh_cache-fa0a87a2-9816-4aed-901d-1dff953f8046" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.network.neutron [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Updating instance_info_cache with network_info: [{"id": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "address": "fa:16:3e:23:f4:e4", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b110e2-ce", "ovs_interfaceid": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Releasing lock "refresh_cache-fa0a87a2-9816-4aed-901d-1dff953f8046" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Instance network_info: |[{"id": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "address": "fa:16:3e:23:f4:e4", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b110e2-ce", "ovs_interfaceid": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f6f4fe9a-1b76-4261-84f2-d6e1a837f057 req-8cebdde0-0376-4424-9ac2-6645aaf37d10 service nova] Acquired lock "refresh_cache-fa0a87a2-9816-4aed-901d-1dff953f8046" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.network.neutron [req-f6f4fe9a-1b76-4261-84f2-d6e1a837f057 req-8cebdde0-0376-4424-9ac2-6645aaf37d10 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Refreshing network info cache for port 97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Start _get_guest_xml network_info=[{"id": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "address": "fa:16:3e:23:f4:e4", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b110e2-ce", "ovs_interfaceid": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:04:24 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:04:24 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1294064360',display_name='tempest-AttachVolumeTestJSON-server-1294064360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1294064360',id=26,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmEO0HP9Il7TVGdcBd3B0rocuuBBbVK8yrlZ7tHCYbGATPKjGALRLpNygosPR3bhkKJFBWaKs4CbAu58gTuCWYKBQSSsij75fZQuC7aYCG0WsI42+MTIBEtrjmmKpnXQw==',key_name='tempest-keypair-2014358242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb016b8ab299475e9f916809c7b55182',ramdisk_id='',reservation_id='r-kf17bhmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1462912324',owner_user_name='tempest-AttachVolumeTestJSON-1462912324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c894534b34d943229dc89f6d58836acb',uuid=fa0a87a2-9816-4aed-901d-1dff953f8046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "address": "fa:16:3e:23:f4:e4", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b110e2-ce", "ovs_interfaceid": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converting VIF {"id": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "address": "fa:16:3e:23:f4:e4", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b110e2-ce", "ovs_interfaceid": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:e4,bridge_name='br-int',has_traffic_filtering=True,id=97b110e2-ceca-4ed9-8886-8d7d2149339f,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b110e2-ce') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.objects.instance [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'pci_devices' on Instance uuid fa0a87a2-9816-4aed-901d-1dff953f8046 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:04:24 user nova-compute[72815]:   <uuid>fa0a87a2-9816-4aed-901d-1dff953f8046</uuid>
Aug 17 20:04:24 user nova-compute[72815]:   <name>instance-0000001a</name>
Aug 17 20:04:24 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:04:24 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:04:24 user nova-compute[72815]:   <metadata>
Aug 17 20:04:24 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:04:24 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:04:24 user nova-compute[72815]:       <nova:name>tempest-AttachVolumeTestJSON-server-1294064360</nova:name>
Aug 17 20:04:24 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:04:24</nova:creationTime>
Aug 17 20:04:24 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:04:24 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:04:24 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:04:24 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:04:24 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:04:24 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:04:24 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:04:24 user nova-compute[72815]:       <nova:owner>
Aug 17 20:04:24 user nova-compute[72815]:         <nova:user uuid="c894534b34d943229dc89f6d58836acb">tempest-AttachVolumeTestJSON-1462912324-project-member</nova:user>
Aug 17 20:04:24 user nova-compute[72815]:         <nova:project uuid="fb016b8ab299475e9f916809c7b55182">tempest-AttachVolumeTestJSON-1462912324</nova:project>
Aug 17 20:04:24 user nova-compute[72815]:       </nova:owner>
Aug 17 20:04:24 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:04:24 user nova-compute[72815]:       <nova:ports>
Aug 17 20:04:24 user nova-compute[72815]:         <nova:port uuid="97b110e2-ceca-4ed9-8886-8d7d2149339f">
Aug 17 20:04:24 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 20:04:24 user nova-compute[72815]:         </nova:port>
Aug 17 20:04:24 user nova-compute[72815]:       </nova:ports>
Aug 17 20:04:24 user nova-compute[72815]:     </nova:instance>
Aug 17 20:04:24 user nova-compute[72815]:   </metadata>
Aug 17 20:04:24 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:04:24 user nova-compute[72815]:     <system>
Aug 17 20:04:24 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:04:24 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:04:24 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:04:24 user nova-compute[72815]:       <entry name="serial">fa0a87a2-9816-4aed-901d-1dff953f8046</entry>
Aug 17 20:04:24 user nova-compute[72815]:       <entry name="uuid">fa0a87a2-9816-4aed-901d-1dff953f8046</entry>
Aug 17 20:04:24 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:04:24 user nova-compute[72815]:     </system>
Aug 17 20:04:24 user nova-compute[72815]:   </sysinfo>
Aug 17 20:04:24 user nova-compute[72815]:   <os>
Aug 17 20:04:24 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:04:24 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:04:24 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:04:24 user nova-compute[72815]:   </os>
Aug 17 20:04:24 user nova-compute[72815]:   <features>
Aug 17 20:04:24 user nova-compute[72815]:     <acpi/>
Aug 17 20:04:24 user nova-compute[72815]:     <apic/>
Aug 17 20:04:24 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:04:24 user nova-compute[72815]:   </features>
Aug 17 20:04:24 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:04:24 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:04:24 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:04:24 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:04:24 user nova-compute[72815]:   </clock>
Aug 17 20:04:24 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:04:24 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:04:24 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:04:24 user nova-compute[72815]:   </cpu>
Aug 17 20:04:24 user nova-compute[72815]:   <devices>
Aug 17 20:04:24 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:04:24 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:04:24 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk"/>
Aug 17 20:04:24 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:04:24 user nova-compute[72815]:     </disk>
Aug 17 20:04:24 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:04:24 user nova-compute[72815]:       <mac address="fa:16:3e:23:f4:e4"/>
Aug 17 20:04:24 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:04:24 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:04:24 user nova-compute[72815]:       <target dev="tap97b110e2-ce"/>
Aug 17 20:04:24 user nova-compute[72815]:     </interface>
Aug 17 20:04:24 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:04:24 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/console.log" append="off"/>
Aug 17 20:04:24 user nova-compute[72815]:     </serial>
Aug 17 20:04:24 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:04:24 user nova-compute[72815]:     <video>
Aug 17 20:04:24 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:04:24 user nova-compute[72815]:     </video>
Aug 17 20:04:24 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:04:24 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:04:24 user nova-compute[72815]:     </rng>
Aug 17 20:04:24 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:04:24 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:04:24 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:04:24 user nova-compute[72815]:     </memballoon>
Aug 17 20:04:24 user nova-compute[72815]:   </devices>
Aug 17 20:04:24 user nova-compute[72815]: </domain>
Aug 17 20:04:24 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1294064360',display_name='tempest-AttachVolumeTestJSON-server-1294064360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1294064360',id=26,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmEO0HP9Il7TVGdcBd3B0rocuuBBbVK8yrlZ7tHCYbGATPKjGALRLpNygosPR3bhkKJFBWaKs4CbAu58gTuCWYKBQSSsij75fZQuC7aYCG0WsI42+MTIBEtrjmmKpnXQw==',key_name='tempest-keypair-2014358242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb016b8ab299475e9f916809c7b55182',ramdisk_id='',reservation_id='r-kf17bhmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1462912324',owner_user_name='tempest-AttachVolumeTestJSON-1462912324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c894534b34d943229dc89f6d58836acb',uuid=fa0a87a2-9816-4aed-901d-1dff953f8046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "address": "fa:16:3e:23:f4:e4", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b110e2-ce", "ovs_interfaceid": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converting VIF {"id": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "address": "fa:16:3e:23:f4:e4", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b110e2-ce", "ovs_interfaceid": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:e4,bridge_name='br-int',has_traffic_filtering=True,id=97b110e2-ceca-4ed9-8886-8d7d2149339f,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b110e2-ce') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG os_vif [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:e4,bridge_name='br-int',has_traffic_filtering=True,id=97b110e2-ceca-4ed9-8886-8d7d2149339f,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b110e2-ce') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97b110e2-ce, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97b110e2-ce, col_values=(('external_ids', {'iface-id': '97b110e2-ceca-4ed9-8886-8d7d2149339f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:f4:e4', 'vm-uuid': 'fa0a87a2-9816-4aed-901d-1dff953f8046'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:24 user nova-compute[72815]: INFO os_vif [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:e4,bridge_name='br-int',has_traffic_filtering=True,id=97b110e2-ceca-4ed9-8886-8d7d2149339f,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b110e2-ce')
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:04:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No VIF found with MAC fa:16:3e:23:f4:e4, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:04:25 user nova-compute[72815]: DEBUG nova.network.neutron [req-f6f4fe9a-1b76-4261-84f2-d6e1a837f057 req-8cebdde0-0376-4424-9ac2-6645aaf37d10 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Updated VIF entry in instance network info cache for port 97b110e2-ceca-4ed9-8886-8d7d2149339f. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:04:25 user nova-compute[72815]: DEBUG nova.network.neutron [req-f6f4fe9a-1b76-4261-84f2-d6e1a837f057 req-8cebdde0-0376-4424-9ac2-6645aaf37d10 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Updating instance_info_cache with network_info: [{"id": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "address": "fa:16:3e:23:f4:e4", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b110e2-ce", "ovs_interfaceid": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:04:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f6f4fe9a-1b76-4261-84f2-d6e1a837f057 req-8cebdde0-0376-4424-9ac2-6645aaf37d10 service nova] Releasing lock "refresh_cache-fa0a87a2-9816-4aed-901d-1dff953f8046" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:04:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-cd677f16-0672-49b9-b942-2218bd37d0b2 req-2ea1554b-d577-4f10-8465-259de7e848e7 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cd677f16-0672-49b9-b942-2218bd37d0b2 req-2ea1554b-d577-4f10-8465-259de7e848e7 service nova] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cd677f16-0672-49b9-b942-2218bd37d0b2 req-2ea1554b-d577-4f10-8465-259de7e848e7 service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cd677f16-0672-49b9-b942-2218bd37d0b2 req-2ea1554b-d577-4f10-8465-259de7e848e7 service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-cd677f16-0672-49b9-b942-2218bd37d0b2 req-2ea1554b-d577-4f10-8465-259de7e848e7 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] No waiting events found dispatching network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:26 user nova-compute[72815]: WARNING nova.compute.manager [req-cd677f16-0672-49b9-b942-2218bd37d0b2 req-2ea1554b-d577-4f10-8465-259de7e848e7 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received unexpected event network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f for instance with vm_state building and task_state spawning.
Aug 17 20:04:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302668.4853742, fa0a87a2-9816-4aed-901d-1dff953f8046 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:04:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] VM Resumed (Lifecycle Event)
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:04:28 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Instance spawned successfully.
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:04:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302668.488636, fa0a87a2-9816-4aed-901d-1dff953f8046 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:04:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] VM Started (Lifecycle Event)
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:04:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:04:28 user nova-compute[72815]: INFO nova.compute.manager [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-a52c98f6-6bf3-4517-8fed-253d239ec5ee req-e66ee805-6517-44d9-a2b9-a6524eb1a70e service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a52c98f6-6bf3-4517-8fed-253d239ec5ee req-e66ee805-6517-44d9-a2b9-a6524eb1a70e service nova] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a52c98f6-6bf3-4517-8fed-253d239ec5ee req-e66ee805-6517-44d9-a2b9-a6524eb1a70e service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a52c98f6-6bf3-4517-8fed-253d239ec5ee req-e66ee805-6517-44d9-a2b9-a6524eb1a70e service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-a52c98f6-6bf3-4517-8fed-253d239ec5ee req-e66ee805-6517-44d9-a2b9-a6524eb1a70e service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] No waiting events found dispatching network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:28 user nova-compute[72815]: WARNING nova.compute.manager [req-a52c98f6-6bf3-4517-8fed-253d239ec5ee req-e66ee805-6517-44d9-a2b9-a6524eb1a70e service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received unexpected event network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f for instance with vm_state building and task_state spawning.
Aug 17 20:04:28 user nova-compute[72815]: INFO nova.compute.manager [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Took 7.12 seconds to build instance.
Aug 17 20:04:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ea6243f9-58aa-4ae3-9d0e-31ac8f707900 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.217s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:04:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:04:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:04:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:04:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:35 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:04:35 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7102MB free_disk=25.364852905273438GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 3a4f27f3-4573-43b5-827a-bbdae4ebce10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 71e8c292-6412-4079-8a2c-11c65c808588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance d45cf87c-d69c-4334-8638-0b92ae395e99 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 12a34846-1670-4c6c-ac7d-522530aaf3a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ee4a8248-9abc-45b3-9bf6-349c4d11f189 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 72c9428f-f797-46b4-9780-d2a4abb01ae7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance fa0a87a2-9816-4aed-901d-1dff953f8046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Refreshing inventories for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Updating ProviderTree inventory for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Updating inventory in ProviderTree for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Refreshing aggregate associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, aggregates: None {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Refreshing trait associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] There are 0 instances to clean {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:04:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 20:04:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:36 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:04:36 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:04:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:04:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:04:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:04:36 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:04:37 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Updating instance_info_cache with network_info: [{"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:04:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:04:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:04:37 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:04:37 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:04:37 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:04:37 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:04:37 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:04:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:04:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-23d33f19-f0a6-487a-872c-b32b48c0caaa req-cab591cf-879d-4ccb-a74f-61d8b25030c0 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-changed-81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-23d33f19-f0a6-487a-872c-b32b48c0caaa req-cab591cf-879d-4ccb-a74f-61d8b25030c0 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing instance network info cache due to event network-changed-81faaa84-44af-45f7-bca9-0bf1dfd299de. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:04:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-23d33f19-f0a6-487a-872c-b32b48c0caaa req-cab591cf-879d-4ccb-a74f-61d8b25030c0 service nova] Acquiring lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:04:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-23d33f19-f0a6-487a-872c-b32b48c0caaa req-cab591cf-879d-4ccb-a74f-61d8b25030c0 service nova] Acquired lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:04:40 user nova-compute[72815]: DEBUG nova.network.neutron [req-23d33f19-f0a6-487a-872c-b32b48c0caaa req-cab591cf-879d-4ccb-a74f-61d8b25030c0 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Refreshing network info cache for port 81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:04:41 user nova-compute[72815]: DEBUG nova.network.neutron [req-23d33f19-f0a6-487a-872c-b32b48c0caaa req-cab591cf-879d-4ccb-a74f-61d8b25030c0 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updated VIF entry in instance network info cache for port 81faaa84-44af-45f7-bca9-0bf1dfd299de. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:04:41 user nova-compute[72815]: DEBUG nova.network.neutron [req-23d33f19-f0a6-487a-872c-b32b48c0caaa req-cab591cf-879d-4ccb-a74f-61d8b25030c0 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [{"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "address": "fa:16:3e:aa:e9:9e", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba0398c-a9", "ovs_interfaceid": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "address": "fa:16:3e:f6:10:47", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a8e140-3c", "ovs_interfaceid": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:04:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-23d33f19-f0a6-487a-872c-b32b48c0caaa req-cab591cf-879d-4ccb-a74f-61d8b25030c0 service nova] Releasing lock "refresh_cache-d45cf87c-d69c-4334-8638-0b92ae395e99" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:04:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:43 user nova-compute[72815]: INFO nova.compute.manager [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Terminating instance
Aug 17 20:04:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-6d16982d-eaae-4adb-a749-bb2a96af5cde req-32accde6-a7eb-4deb-bee7-c618753fc1b2 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-24d97c14-9767-4d76-a34c-b8e5d4585592 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6d16982d-eaae-4adb-a749-bb2a96af5cde req-32accde6-a7eb-4deb-bee7-c618753fc1b2 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6d16982d-eaae-4adb-a749-bb2a96af5cde req-32accde6-a7eb-4deb-bee7-c618753fc1b2 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6d16982d-eaae-4adb-a749-bb2a96af5cde req-32accde6-a7eb-4deb-bee7-c618753fc1b2 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-6d16982d-eaae-4adb-a749-bb2a96af5cde req-32accde6-a7eb-4deb-bee7-c618753fc1b2 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-unplugged-24d97c14-9767-4d76-a34c-b8e5d4585592 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-6d16982d-eaae-4adb-a749-bb2a96af5cde req-32accde6-a7eb-4deb-bee7-c618753fc1b2 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-24d97c14-9767-4d76-a34c-b8e5d4585592 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-d25e3631-e277-4f16-b9e6-fb6d61b630e4 req-b0276a5c-ff8e-40ab-add1-c4079580a916 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25e3631-e277-4f16-b9e6-fb6d61b630e4 req-b0276a5c-ff8e-40ab-add1-c4079580a916 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25e3631-e277-4f16-b9e6-fb6d61b630e4 req-b0276a5c-ff8e-40ab-add1-c4079580a916 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d25e3631-e277-4f16-b9e6-fb6d61b630e4 req-b0276a5c-ff8e-40ab-add1-c4079580a916 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-d25e3631-e277-4f16-b9e6-fb6d61b630e4 req-b0276a5c-ff8e-40ab-add1-c4079580a916 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-unplugged-81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-d25e3631-e277-4f16-b9e6-fb6d61b630e4 req-b0276a5c-ff8e-40ab-add1-c4079580a916 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-81faaa84-44af-45f7-bca9-0bf1dfd299de for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-fa29350a-c7e7-4451-9236-f9f61fe64442 req-ab037886-f931-499d-978c-35785c4f717e service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fa29350a-c7e7-4451-9236-f9f61fe64442 req-ab037886-f931-499d-978c-35785c4f717e service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fa29350a-c7e7-4451-9236-f9f61fe64442 req-ab037886-f931-499d-978c-35785c4f717e service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fa29350a-c7e7-4451-9236-f9f61fe64442 req-ab037886-f931-499d-978c-35785c4f717e service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-fa29350a-c7e7-4451-9236-f9f61fe64442 req-ab037886-f931-499d-978c-35785c4f717e service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-unplugged-72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-fa29350a-c7e7-4451-9236-f9f61fe64442 req-ab037886-f931-499d-978c-35785c4f717e service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-72a288ef-76e2-4e98-bb56-8b0d9f28f078 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:44 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Instance destroyed successfully.
Aug 17 20:04:44 user nova-compute[72815]: DEBUG nova.objects.instance [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lazy-loading 'resources' on Instance uuid d45cf87c-d69c-4334-8638-0b92ae395e99 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:02:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:7f:b5,bridge_name='br-int',has_traffic_filtering=True,id=81faaa84-44af-45f7-bca9-0bf1dfd299de,network=Network(fb515358-ed40-434f-9826-4d8b6a558fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81faaa84-44') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:7f:b5,bridge_name='br-int',has_traffic_filtering=True,id=81faaa84-44af-45f7-bca9-0bf1dfd299de,network=Network(fb515358-ed40-434f-9826-4d8b6a558fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81faaa84-44') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81faaa84-44, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: INFO os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:7f:b5,bridge_name='br-int',has_traffic_filtering=True,id=81faaa84-44af-45f7-bca9-0bf1dfd299de,network=Network(fb515358-ed40-434f-9826-4d8b6a558fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81faaa84-44')
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:02:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e9:97,bridge_name='br-int',has_traffic_filtering=True,id=24d97c14-9767-4d76-a34c-b8e5d4585592,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24d97c14-97') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e9:97,bridge_name='br-int',has_traffic_filtering=True,id=24d97c14-9767-4d76-a34c-b8e5d4585592,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24d97c14-97') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24d97c14-97, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: INFO os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e9:97,bridge_name='br-int',has_traffic_filtering=True,id=24d97c14-9767-4d76-a34c-b8e5d4585592,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24d97c14-97')
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:02:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:00:9e,bridge_name='br-int',has_traffic_filtering=True,id=a8299182-2e48-4a58-83a4-1e546caaeeae,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8299182-2e') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:00:9e,bridge_name='br-int',has_traffic_filtering=True,id=a8299182-2e48-4a58-83a4-1e546caaeeae,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8299182-2e') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8299182-2e, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: INFO os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:00:9e,bridge_name='br-int',has_traffic_filtering=True,id=a8299182-2e48-4a58-83a4-1e546caaeeae,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8299182-2e')
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:02:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:59,bridge_name='br-int',has_traffic_filtering=True,id=72a288ef-76e2-4e98-bb56-8b0d9f28f078,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a288ef-76') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:59,bridge_name='br-int',has_traffic_filtering=True,id=72a288ef-76e2-4e98-bb56-8b0d9f28f078,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a288ef-76') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72a288ef-76, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: INFO os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:59,bridge_name='br-int',has_traffic_filtering=True,id=72a288ef-76e2-4e98-bb56-8b0d9f28f078,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a288ef-76')
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:02:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:93:94,bridge_name='br-int',has_traffic_filtering=True,id=14643db7-4fda-41a1-b528-a11fc8dfca07,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14643db7-4f') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:93:94,bridge_name='br-int',has_traffic_filtering=True,id=14643db7-4fda-41a1-b528-a11fc8dfca07,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14643db7-4f') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14643db7-4f, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: INFO os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:93:94,bridge_name='br-int',has_traffic_filtering=True,id=14643db7-4fda-41a1-b528-a11fc8dfca07,network=Network(d790d674-c6d7-4bf1-8823-510185368392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14643db7-4f')
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:02:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "address": "fa:16:3e:aa:e9:9e", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba0398c-a9", "ovs_interfaceid": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "address": "fa:16:3e:aa:e9:9e", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba0398c-a9", "ovs_interfaceid": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e9:9e,bridge_name='br-int',has_traffic_filtering=True,id=6ba0398c-a9e2-4608-aa03-f8baed9efa56,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba0398c-a9') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e9:9e,bridge_name='br-int',has_traffic_filtering=True,id=6ba0398c-a9e2-4608-aa03-f8baed9efa56,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba0398c-a9') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ba0398c-a9, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: INFO os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e9:9e,bridge_name='br-int',has_traffic_filtering=True,id=6ba0398c-a9e2-4608-aa03-f8baed9efa56,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba0398c-a9')
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T20:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-449057570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-449057570',id=23,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVONWPDWHVmeG+K+4MfOCbYivgXZmui4eUTad8vXP1DZqqNryqwKcCbzuw15mCAw6fweUbVN6nGA2nB0AwsfUxZGREAhVTIS1mImqmQ8wkV0F0iNHxYpb6+FHJi/tqWpw==',key_name='tempest-keypair-1954425733',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:02:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28eef397b2824b58bafe33616d7c48c9',ramdisk_id='',reservation_id='r-4eonj1n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1656341443',owner_user_name='tempest-TaggedBootDevicesTest-1656341443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2b94419b4fc41f7b5303c6f98a503fb',uuid=d45cf87c-d69c-4334-8638-0b92ae395e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "address": "fa:16:3e:f6:10:47", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a8e140-3c", "ovs_interfaceid": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converting VIF {"id": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "address": "fa:16:3e:f6:10:47", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a8e140-3c", "ovs_interfaceid": "e7a8e140-3c2b-4a89-af4b-4ccc271357e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:47,bridge_name='br-int',has_traffic_filtering=True,id=e7a8e140-3c2b-4a89-af4b-4ccc271357e1,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a8e140-3c') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:47,bridge_name='br-int',has_traffic_filtering=True,id=e7a8e140-3c2b-4a89-af4b-4ccc271357e1,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a8e140-3c') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7a8e140-3c, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:04:45 user nova-compute[72815]: INFO os_vif [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:47,bridge_name='br-int',has_traffic_filtering=True,id=e7a8e140-3c2b-4a89-af4b-4ccc271357e1,network=Network(b2b7f54e-1361-44ac-b3f0-7250cbcd3808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a8e140-3c')
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYdDVWbo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:04:45 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a50bb66-27f2-4055-b27d-bdcf29ed6837]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[609d287a-9cca-40dd-bd32-8e18eada179a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944dc940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6'): ({'sdb'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Removing single pathed devices sdb {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eed2aeb-e6d8-4a59-8a3c-80012c84164a]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a28b59f-c82d-47fc-95ca-995a8c46e569]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Flushing IO for device /dev/sdb {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc52b66-6953-4f7b-bc46-1fdab3475650]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4521df23-358a-4533-b34e-0bcb8e4f46f9]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a464234a-bf3d-4604-aae0-047859881418]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64a3924-f389-4f21-aa7a-5b55627c5735]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6, portal: 172.16.0.220,3260]
Aug 17 20:04:45 user nova-compute[72815]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6, portal: 172.16.0.220,3260] successful.
Aug 17 20:04:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b4030a-a6cd-446d-8014-480d030fabb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccb5c78-fb19-48bf-9d4b-e244cc582f2f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] <== disconnect_volume: return (364ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHeybAuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:04:45 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa1c20c-55df-4138-9da4-d9e6c1b23781]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[588cc03e-0732-454b-9f00-3d61c255045d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b41f9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49'): ({'sdd'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Removing single pathed devices sdd {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3754886f-42be-46e6-8954-c3e4fc64b392]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aefc09-e28c-4138-b10b-8292f71cb449]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Flushing IO for device /dev/sdd {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8109daa6-987d-4809-8f1b-22c66d7fcb9c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-24d97c14-9767-4d76-a34c-b8e5d4585592 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-24d97c14-9767-4d76-a34c-b8e5d4585592 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:45 user nova-compute[72815]: WARNING nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-24d97c14-9767-4d76-a34c-b8e5d4585592 for instance with vm_state active and task_state deleting.
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-a8299182-2e48-4a58-83a4-1e546caaeeae {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-unplugged-a8299182-2e48-4a58-83a4-1e546caaeeae {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-a8299182-2e48-4a58-83a4-1e546caaeeae for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-a8299182-2e48-4a58-83a4-1e546caaeeae {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-a8299182-2e48-4a58-83a4-1e546caaeeae {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:45 user nova-compute[72815]: WARNING nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-a8299182-2e48-4a58-83a4-1e546caaeeae for instance with vm_state active and task_state deleting.
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-unplugged-14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-14643db7-4fda-41a1-b528-a11fc8dfca07 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:45 user nova-compute[72815]: WARNING nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-14643db7-4fda-41a1-b528-a11fc8dfca07 for instance with vm_state active and task_state deleting.
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-unplugged-6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-6ba0398c-a9e2-4608-aa03-f8baed9efa56 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:45 user nova-compute[72815]: WARNING nova.compute.manager [req-fd52a9ff-3ec9-4aba-ab87-5892a3151e71 req-5da51c9b-0d1b-4092-890f-a3d8a7e87774 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-6ba0398c-a9e2-4608-aa03-f8baed9efa56 for instance with vm_state active and task_state deleting.
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64ea33b-0e71-44b8-b930-06b4779dfaa5]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e238ed-bdde-460e-8540-5febd72b1924]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[354d813d-4335-494e-b0cb-b32fbcd54782]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49, portal: 172.16.0.220,3260]
Aug 17 20:04:46 user nova-compute[72815]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49, portal: 172.16.0.220,3260] successful.
Aug 17 20:04:46 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704aec49-8456-46f7-8d02-b0b837bb7e49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9670616f-18b5-4411-a1a4-622f67104597]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] <== disconnect_volume: return (327ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuUZchCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:04:46 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:46 user nova-compute[72815]: WARNING nova.compute.manager [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-81faaa84-44af-45f7-bca9-0bf1dfd299de for instance with vm_state active and task_state deleting.
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-unplugged-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-unplugged-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:46 user nova-compute[72815]: WARNING nova.compute.manager [req-d1c1d722-a2ab-43c1-bff5-43fbf60f41f0 req-4a6bbb5b-d271-4666-8b7d-95d0a2981265 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 for instance with vm_state active and task_state deleting.
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e032fe3b-249b-4537-922e-a96ec10dbbd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5be812-064a-4e79-8892-70b6d2a1cc2b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:46 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:46 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:46 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:46 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:04:46 user nova-compute[72815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 (non-flash)
Aug 17 20:04:46 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:04:46 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:04:46 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b43d31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570'): ({'sde'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Removing single pathed devices sde {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa4ea34-1333-4f00-bac0-6974d6b0d223]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-33676fa6-ce14-45fa-b29c-ea0aab7d120b req-6904120f-7257-45d1-83c6-45e832843062 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-plugged-72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-33676fa6-ce14-45fa-b29c-ea0aab7d120b req-6904120f-7257-45d1-83c6-45e832843062 service nova] Acquiring lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-33676fa6-ce14-45fa-b29c-ea0aab7d120b req-6904120f-7257-45d1-83c6-45e832843062 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-33676fa6-ce14-45fa-b29c-ea0aab7d120b req-6904120f-7257-45d1-83c6-45e832843062 service nova] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-33676fa6-ce14-45fa-b29c-ea0aab7d120b req-6904120f-7257-45d1-83c6-45e832843062 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] No waiting events found dispatching network-vif-plugged-72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:04:46 user nova-compute[72815]: WARNING nova.compute.manager [req-33676fa6-ce14-45fa-b29c-ea0aab7d120b req-6904120f-7257-45d1-83c6-45e832843062 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received unexpected event network-vif-plugged-72a288ef-76e2-4e98-bb56-8b0d9f28f078 for instance with vm_state active and task_state deleting.
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b471bd-17ab-4277-b904-a3012530ccf9]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Flushing IO for device /dev/sde {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d859c2-a1af-43f3-b937-d7e596ea2598]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fe1208-2195-4dba-9c8f-063d3455e009]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54f1e39-e060-4fad-896d-cfcebae3c6d2]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41d3ccd-2f02-4e79-9915-73c6679af083]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570, portal: 172.16.0.220,3260]
Aug 17 20:04:46 user nova-compute[72815]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570, portal: 172.16.0.220,3260] successful.
Aug 17 20:04:46 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57fa4a25-c0db-4be9-bc59-0813a0ead570 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5008dcbb-4bb5-45b9-97d3-b6e5e9460d0a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] <== disconnect_volume: return (339ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:04:46 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Deleting instance files /opt/stack/data/nova/instances/d45cf87c-d69c-4334-8638-0b92ae395e99_del
Aug 17 20:04:46 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Deletion of /opt/stack/data/nova/instances/d45cf87c-d69c-4334-8638-0b92ae395e99_del complete
Aug 17 20:04:46 user nova-compute[72815]: INFO nova.compute.manager [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Took 3.21 seconds to destroy the instance on the hypervisor.
Aug 17 20:04:46 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:04:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-b64e6142-f24e-4416-8bb7-e03b15996f3f req-d3f7effe-454c-402a-8f06-5fc8155fe18d service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-deleted-e7a8e140-3c2b-4a89-af4b-4ccc271357e1 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:48 user nova-compute[72815]: INFO nova.compute.manager [req-b64e6142-f24e-4416-8bb7-e03b15996f3f req-d3f7effe-454c-402a-8f06-5fc8155fe18d service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Neutron deleted interface e7a8e140-3c2b-4a89-af4b-4ccc271357e1; detaching it from the instance and deleting it from the info cache
Aug 17 20:04:48 user nova-compute[72815]: DEBUG nova.network.neutron [req-b64e6142-f24e-4416-8bb7-e03b15996f3f req-d3f7effe-454c-402a-8f06-5fc8155fe18d service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [{"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "address": "fa:16:3e:aa:e9:9e", "network": {"id": "b2b7f54e-1361-44ac-b3f0-7250cbcd3808", "bridge": "br-int", "label": "tempest-device-tagging-net2-1465304292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba0398c-a9", "ovs_interfaceid": "6ba0398c-a9e2-4608-aa03-f8baed9efa56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:04:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-b64e6142-f24e-4416-8bb7-e03b15996f3f req-d3f7effe-454c-402a-8f06-5fc8155fe18d service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Detach interface failed, port_id=e7a8e140-3c2b-4a89-af4b-4ccc271357e1, reason: Instance d45cf87c-d69c-4334-8638-0b92ae395e99 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:04:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-5c41b068-75a3-4763-8f6d-dc133a38a46f req-b57e691f-7283-42ba-8087-e86c806b8ce5 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-deleted-6ba0398c-a9e2-4608-aa03-f8baed9efa56 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:50 user nova-compute[72815]: INFO nova.compute.manager [req-5c41b068-75a3-4763-8f6d-dc133a38a46f req-b57e691f-7283-42ba-8087-e86c806b8ce5 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Neutron deleted interface 6ba0398c-a9e2-4608-aa03-f8baed9efa56; detaching it from the instance and deleting it from the info cache
Aug 17 20:04:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-5c41b068-75a3-4763-8f6d-dc133a38a46f req-b57e691f-7283-42ba-8087-e86c806b8ce5 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [{"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "address": "fa:16:3e:0f:17:59", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a288ef-76", "ovs_interfaceid": "72a288ef-76e2-4e98-bb56-8b0d9f28f078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:04:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-5c41b068-75a3-4763-8f6d-dc133a38a46f req-b57e691f-7283-42ba-8087-e86c806b8ce5 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Detach interface failed, port_id=6ba0398c-a9e2-4608-aa03-f8baed9efa56, reason: Instance d45cf87c-d69c-4334-8638-0b92ae395e99 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:04:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-5c41b068-75a3-4763-8f6d-dc133a38a46f req-b57e691f-7283-42ba-8087-e86c806b8ce5 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-deleted-72a288ef-76e2-4e98-bb56-8b0d9f28f078 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:50 user nova-compute[72815]: INFO nova.compute.manager [req-5c41b068-75a3-4763-8f6d-dc133a38a46f req-b57e691f-7283-42ba-8087-e86c806b8ce5 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Neutron deleted interface 72a288ef-76e2-4e98-bb56-8b0d9f28f078; detaching it from the instance and deleting it from the info cache
Aug 17 20:04:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-5c41b068-75a3-4763-8f6d-dc133a38a46f req-b57e691f-7283-42ba-8087-e86c806b8ce5 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [{"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14643db7-4fda-41a1-b528-a11fc8dfca07", "address": "fa:16:3e:b3:93:94", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14643db7-4f", "ovs_interfaceid": "14643db7-4fda-41a1-b528-a11fc8dfca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:04:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-5c41b068-75a3-4763-8f6d-dc133a38a46f req-b57e691f-7283-42ba-8087-e86c806b8ce5 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Detach interface failed, port_id=72a288ef-76e2-4e98-bb56-8b0d9f28f078, reason: Instance d45cf87c-d69c-4334-8638-0b92ae395e99 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:04:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-5c41b068-75a3-4763-8f6d-dc133a38a46f req-b57e691f-7283-42ba-8087-e86c806b8ce5 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-deleted-14643db7-4fda-41a1-b528-a11fc8dfca07 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:50 user nova-compute[72815]: INFO nova.compute.manager [req-5c41b068-75a3-4763-8f6d-dc133a38a46f req-b57e691f-7283-42ba-8087-e86c806b8ce5 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Neutron deleted interface 14643db7-4fda-41a1-b528-a11fc8dfca07; detaching it from the instance and deleting it from the info cache
Aug 17 20:04:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-5c41b068-75a3-4763-8f6d-dc133a38a46f req-b57e691f-7283-42ba-8087-e86c806b8ce5 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [{"id": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "address": "fa:16:3e:0a:7f:b5", "network": {"id": "fb515358-ed40-434f-9826-4d8b6a558fdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2119913081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81faaa84-44", "ovs_interfaceid": "81faaa84-44af-45f7-bca9-0bf1dfd299de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24d97c14-9767-4d76-a34c-b8e5d4585592", "address": "fa:16:3e:9a:e9:97", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24d97c14-97", "ovs_interfaceid": "24d97c14-9767-4d76-a34c-b8e5d4585592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8299182-2e48-4a58-83a4-1e546caaeeae", "address": "fa:16:3e:24:00:9e", "network": {"id": "d790d674-c6d7-4bf1-8823-510185368392", "bridge": "br-int", "label": "tempest-device-tagging-net1-1079687685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28eef397b2824b58bafe33616d7c48c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8299182-2e", "ovs_interfaceid": "a8299182-2e48-4a58-83a4-1e546caaeeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:04:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-5c41b068-75a3-4763-8f6d-dc133a38a46f req-b57e691f-7283-42ba-8087-e86c806b8ce5 service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Detach interface failed, port_id=14643db7-4fda-41a1-b528-a11fc8dfca07, reason: Instance d45cf87c-d69c-4334-8638-0b92ae395e99 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:04:51 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:04:51 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Took 5.11 seconds to deallocate network for instance.
Aug 17 20:04:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-c553b5a3-9efb-44cd-87b4-a029d7160fe1 req-c3e2f783-b762-46f0-a9d6-eb5a9e048b1a service nova] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Received event network-vif-deleted-81faaa84-44af-45f7-bca9-0bf1dfd299de {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:04:54 user nova-compute[72815]: INFO nova.compute.manager [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Took 2.63 seconds to detach 3 volumes for instance.
Aug 17 20:04:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:04:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:04:54 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:04:54 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:04:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:54 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Deleted allocations for instance d45cf87c-d69c-4334-8638-0b92ae395e99
Aug 17 20:04:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-56435b5e-2ffa-4c35-a843-8298e02238c9 tempest-TaggedBootDevicesTest-1656341443 tempest-TaggedBootDevicesTest-1656341443-project-member] Lock "d45cf87c-d69c-4334-8638-0b92ae395e99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.494s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:04:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:04:59 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302684.989082, d45cf87c-d69c-4334-8638-0b92ae395e99 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:04:59 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] VM Stopped (Lifecycle Event)
Aug 17 20:05:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f64d614a-32b3-4dc7-b7d2-26f2d2bc81a1 None None] [instance: d45cf87c-d69c-4334-8638-0b92ae395e99] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:05:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:04 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:05:04 user nova-compute[72815]: INFO nova.compute.claims [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Claim successful on node user
Aug 17 20:05:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:04 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:05:04 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:05:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:05:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:05:04 user nova-compute[72815]: DEBUG nova.network.neutron [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:05:04 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:05:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:05:04 user nova-compute[72815]: INFO nova.virt.block_device [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Booting with volume-backed-image 03ea87a0-d39d-476c-ae9f-307cb35323b8 at /dev/vda
Aug 17 20:05:05 user nova-compute[72815]: DEBUG nova.policy [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '169121564e514d4f883b71abeb3e6070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c20bd5232b4b058abc1b50f38cade3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:05:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:05 user nova-compute[72815]: INFO nova.compute.manager [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Detaching volume 70e9419b-ebd2-488a-be00-47ecf55e0dc1
Aug 17 20:05:05 user nova-compute[72815]: INFO nova.virt.block_device [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Attempting to driver detach volume 70e9419b-ebd2-488a-be00-47ecf55e0dc1 from mountpoint /dev/vdb
Aug 17 20:05:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Attempting to detach device vdb from instance 71e8c292-6412-4079-8a2c-11c65c808588 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:05:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:05:05 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:05:05 user nova-compute[72815]:   <source dev="/dev/sdh"/>
Aug 17 20:05:05 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:05:05 user nova-compute[72815]:   <serial>70e9419b-ebd2-488a-be00-47ecf55e0dc1</serial>
Aug 17 20:05:05 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:05:05 user nova-compute[72815]: </disk>
Aug 17 20:05:05 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:05:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Successfully detached device vdb from instance 71e8c292-6412-4079-8a2c-11c65c808588 from the persistent domain config.
Aug 17 20:05:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71e8c292-6412-4079-8a2c-11c65c808588 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:05:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:05:05 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:05:05 user nova-compute[72815]:   <source dev="/dev/sdh"/>
Aug 17 20:05:05 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:05:05 user nova-compute[72815]:   <serial>70e9419b-ebd2-488a-be00-47ecf55e0dc1</serial>
Aug 17 20:05:05 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:05:05 user nova-compute[72815]: </disk>
Aug 17 20:05:05 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG nova.network.neutron [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Successfully created port: cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302706.3363824, 71e8c292-6412-4079-8a2c-11c65c808588 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71e8c292-6412-4079-8a2c-11c65c808588 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:05:06 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Successfully detached device vdb from instance 71e8c292-6412-4079-8a2c-11c65c808588 from the live domain config.
Aug 17 20:05:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwPsXcgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:05:06 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7ffded-099a-4510-878b-dd23fac8fe05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6869cdce-4871-4a5d-b675-c4a847ce1cea]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:06 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:05:06 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:05:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:06 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:05:06 user nova-compute[72815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 (non-flash)
Aug 17 20:05:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b4167c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1'): ({'sdh'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Removing single pathed devices sdh {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5547b68-b123-4e67-92de-42d69f781dad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[57058083-bc25-46c2-9956-f6dfb1626f11]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Flushing IO for device /dev/sdh {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9065fadf-cf8a-405a-aa2a-6ded263e797c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.074s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[df728d06-1c74-473a-ab6b-569c5cb12bb4]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] SCSI volumes sdh have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae917e22-c583-41b3-a826-1cef15d802c6]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2483f89a-bbef-4435-a9d9-047540bd7738]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1, portal: 172.16.0.220,3260]
Aug 17 20:05:06 user nova-compute[72815]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1, portal: 172.16.0.220,3260] successful.
Aug 17 20:05:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9419b-ebd2-488a-be00-47ecf55e0dc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad98e0a0-22fb-4be9-a6eb-a14bf72d1cc9]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] <== disconnect_volume: return (318ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:05:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Successfully updated port: cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "refresh_cache-caffa446-5b29-4c5d-b756-4cc7119676cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquired lock "refresh_cache-caffa446-5b29-4c5d-b756-4cc7119676cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-d8bf4047-3010-4c7c-9d01-20099a7a4726 req-c36c31f8-1941-4e36-ab0a-e69e985f28bc service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-changed-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-d8bf4047-3010-4c7c-9d01-20099a7a4726 req-c36c31f8-1941-4e36-ab0a-e69e985f28bc service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Refreshing instance network info cache due to event network-changed-cdd534e6-dcf7-4ddc-8654-5140e12727b0. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d8bf4047-3010-4c7c-9d01-20099a7a4726 req-c36c31f8-1941-4e36-ab0a-e69e985f28bc service nova] Acquiring lock "refresh_cache-caffa446-5b29-4c5d-b756-4cc7119676cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG nova.objects.instance [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lazy-loading 'flavor' on Instance uuid 71e8c292-6412-4079-8a2c-11c65c808588 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Updating instance_info_cache with network_info: [{"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c413402c-520c-4133-b698-feb43b24991a tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.848s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Releasing lock "refresh_cache-caffa446-5b29-4c5d-b756-4cc7119676cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Instance network_info: |[{"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d8bf4047-3010-4c7c-9d01-20099a7a4726 req-c36c31f8-1941-4e36-ab0a-e69e985f28bc service nova] Acquired lock "refresh_cache-caffa446-5b29-4c5d-b756-4cc7119676cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:05:07 user nova-compute[72815]: DEBUG nova.network.neutron [req-d8bf4047-3010-4c7c-9d01-20099a7a4726 req-c36c31f8-1941-4e36-ab0a-e69e985f28bc service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Refreshing network info cache for port cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:05:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-d8bf4047-3010-4c7c-9d01-20099a7a4726 req-c36c31f8-1941-4e36-ab0a-e69e985f28bc service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Updated VIF entry in instance network info cache for port cdd534e6-dcf7-4ddc-8654-5140e12727b0. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:05:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-d8bf4047-3010-4c7c-9d01-20099a7a4726 req-c36c31f8-1941-4e36-ab0a-e69e985f28bc service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Updating instance_info_cache with network_info: [{"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d8bf4047-3010-4c7c-9d01-20099a7a4726 req-c36c31f8-1941-4e36-ab0a-e69e985f28bc service nova] Releasing lock "refresh_cache-caffa446-5b29-4c5d-b756-4cc7119676cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:10 user nova-compute[72815]: INFO nova.compute.manager [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Terminating instance
Aug 17 20:05:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-611bf3bc-917a-4501-9396-1388edc8b61d req-038536aa-2842-4e28-98b9-3c02eb21de35 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-vif-unplugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-611bf3bc-917a-4501-9396-1388edc8b61d req-038536aa-2842-4e28-98b9-3c02eb21de35 service nova] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-611bf3bc-917a-4501-9396-1388edc8b61d req-038536aa-2842-4e28-98b9-3c02eb21de35 service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-611bf3bc-917a-4501-9396-1388edc8b61d req-038536aa-2842-4e28-98b9-3c02eb21de35 service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-611bf3bc-917a-4501-9396-1388edc8b61d req-038536aa-2842-4e28-98b9-3c02eb21de35 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] No waiting events found dispatching network-vif-unplugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-611bf3bc-917a-4501-9396-1388edc8b61d req-038536aa-2842-4e28-98b9-3c02eb21de35 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-vif-unplugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:05:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Instance destroyed successfully.
Aug 17 20:05:11 user nova-compute[72815]: DEBUG nova.objects.instance [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'resources' on Instance uuid ee4a8248-9abc-45b3-9bf6-349c4d11f189 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:05:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T19:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1768421689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1768421689',id=17,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwq6B6YucI61a+XA6DcquTL6Maoiz9alX/+69B1C2l5COMq45Rjhb7PiVHLcsSjjclf89Dqbs4NMf3C5D0xYFGI7dTuolACUVlLGI/QtrqyveSxLlTXfFpvHMAvbRCo5w==',key_name='tempest-keypair-1366413119',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa140294f17e4751b13e2d4a15b17ff9',ramdisk_id='',reservation_id='r-lho37lud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-632866040',owner_user_name='tempest-AttachVolumeShelveTestJSON-632866040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82d9b206cf4499eaf518f7cd6a7a10c',uuid=ee4a8248-9abc-45b3-9bf6-349c4d11f189,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:05:11 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converting VIF {"id": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "address": "fa:16:3e:4e:df:a1", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3639567-a7", "ovs_interfaceid": "b3639567-a71c-4a6c-81b5-0a04aa8800b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:05:11 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:05:11 user nova-compute[72815]: DEBUG os_vif [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:05:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3639567-a7, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:05:11 user nova-compute[72815]: INFO os_vif [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:df:a1,bridge_name='br-int',has_traffic_filtering=True,id=b3639567-a71c-4a6c-81b5-0a04aa8800b2,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3639567-a7')
Aug 17 20:05:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Deleting instance files /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189_del
Aug 17 20:05:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Deletion of /opt/stack/data/nova/instances/ee4a8248-9abc-45b3-9bf6-349c4d11f189_del complete
Aug 17 20:05:11 user nova-compute[72815]: INFO nova.compute.manager [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 20:05:11 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:05:11 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:05:11 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:05:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:12 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:12 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Took 0.83 seconds to deallocate network for instance.
Aug 17 20:05:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-c09577da-a334-4e39-8439-3e2d44d570da req-7766c187-2ab4-4f7e-9f42-f0f4eebfb506 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-vif-deleted-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:12 user nova-compute[72815]: INFO nova.compute.manager [req-c09577da-a334-4e39-8439-3e2d44d570da req-7766c187-2ab4-4f7e-9f42-f0f4eebfb506 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Neutron deleted interface b3639567-a71c-4a6c-81b5-0a04aa8800b2; detaching it from the instance and deleting it from the info cache
Aug 17 20:05:12 user nova-compute[72815]: DEBUG nova.network.neutron [req-c09577da-a334-4e39-8439-3e2d44d570da req-7766c187-2ab4-4f7e-9f42-f0f4eebfb506 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-c09577da-a334-4e39-8439-3e2d44d570da req-7766c187-2ab4-4f7e-9f42-f0f4eebfb506 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Detach interface failed, port_id=b3639567-a71c-4a6c-81b5-0a04aa8800b2, reason: Instance ee4a8248-9abc-45b3-9bf6-349c4d11f189 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:05:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:12 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:05:12 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:05:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:12 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Deleted allocations for instance ee4a8248-9abc-45b3-9bf6-349c4d11f189
Aug 17 20:05:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9715615a-11dd-4b93-b933-d1bfc82c3623 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.322s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-dff1dfc1-9314-4dc9-a441-1d8e69413985 req-f20b5803-feda-4425-b26f-6ccd8d271261 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received event network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dff1dfc1-9314-4dc9-a441-1d8e69413985 req-f20b5803-feda-4425-b26f-6ccd8d271261 service nova] Acquiring lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dff1dfc1-9314-4dc9-a441-1d8e69413985 req-f20b5803-feda-4425-b26f-6ccd8d271261 service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dff1dfc1-9314-4dc9-a441-1d8e69413985 req-f20b5803-feda-4425-b26f-6ccd8d271261 service nova] Lock "ee4a8248-9abc-45b3-9bf6-349c4d11f189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-dff1dfc1-9314-4dc9-a441-1d8e69413985 req-f20b5803-feda-4425-b26f-6ccd8d271261 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] No waiting events found dispatching network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:12 user nova-compute[72815]: WARNING nova.compute.manager [req-dff1dfc1-9314-4dc9-a441-1d8e69413985 req-f20b5803-feda-4425-b26f-6ccd8d271261 service nova] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Received unexpected event network-vif-plugged-b3639567-a71c-4a6c-81b5-0a04aa8800b2 for instance with vm_state deleted and task_state None.
Aug 17 20:05:15 user nova-compute[72815]: DEBUG os_brick.utils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9da4c3-519f-4c39-9f58-483fd86a413c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d72e538-38c5-4c00-b56a-92b2f9d451eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[813d8e66-7f13-4991-95d1-41e25c99a513]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f89dcb-04f7-4525-9111-fd6aa94d4688]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:05:15 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:05:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f13d17-7ec3-497f-aa6f-f8f12b9c9df7]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG os_brick.utils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:05:15 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Updating existing volume attachment record: ed1a6328-4701-4472-a844-145df1b65fb6 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:05:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:05:18 user nova-compute[72815]: INFO nova.compute.claims [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Claim successful on node user
Aug 17 20:05:18 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG nova.network.neutron [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:05:18 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:05:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:05:18 user nova-compute[72815]: INFO nova.virt.block_device [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Booting with volume 228e179c-97dd-4ee6-978b-4450933aa2c9 at /dev/vda
Aug 17 20:05:18 user nova-compute[72815]: DEBUG os_brick.utils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[846e5077-1c32-42ce-a933-627ff54d6591]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e276d5-8123-42e0-8b43-fc87275df80b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e3b0db-c508-4009-af8a-f55d0b095af6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e16714-88cb-41c7-b6d2-2b3fcd3eb3f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:05:19 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:05:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce4d8ff-5183-4c09-9fbb-2b46bca3dab3]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG os_brick.utils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updating existing volume attachment record: 5162331b-32ac-45d4-bc7f-c8da8e6c60f9 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:05:19 user nova-compute[72815]: DEBUG nova.policy [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9821282c73174c448f7fca6b65676f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0708d4f49ed4c96b108d1d2aff76871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:05:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-3da329bb-7f6a-42ce-844f-752957fa87fc req-6613d15a-7925-4ba4-b355-336b824fa184 service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Received event network-changed-28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-3da329bb-7f6a-42ce-844f-752957fa87fc req-6613d15a-7925-4ba4-b355-336b824fa184 service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Refreshing instance network info cache due to event network-changed-28cbd6c4-08ff-4d40-ac71-f26a0b61457d. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:05:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3da329bb-7f6a-42ce-844f-752957fa87fc req-6613d15a-7925-4ba4-b355-336b824fa184 service nova] Acquiring lock "refresh_cache-72c9428f-f797-46b4-9780-d2a4abb01ae7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:05:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3da329bb-7f6a-42ce-844f-752957fa87fc req-6613d15a-7925-4ba4-b355-336b824fa184 service nova] Acquired lock "refresh_cache-72c9428f-f797-46b4-9780-d2a4abb01ae7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:05:20 user nova-compute[72815]: DEBUG nova.network.neutron [req-3da329bb-7f6a-42ce-844f-752957fa87fc req-6613d15a-7925-4ba4-b355-336b824fa184 service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Refreshing network info cache for port 28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:05:21 user nova-compute[72815]: DEBUG nova.network.neutron [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Successfully created port: 8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:05:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:05:21 user nova-compute[72815]: DEBUG nova.network.neutron [req-3da329bb-7f6a-42ce-844f-752957fa87fc req-6613d15a-7925-4ba4-b355-336b824fa184 service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Updated VIF entry in instance network info cache for port 28cbd6c4-08ff-4d40-ac71-f26a0b61457d. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:05:21 user nova-compute[72815]: DEBUG nova.network.neutron [req-3da329bb-7f6a-42ce-844f-752957fa87fc req-6613d15a-7925-4ba4-b355-336b824fa184 service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Updating instance_info_cache with network_info: [{"id": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "address": "fa:16:3e:ba:2a:d7", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbd6c4-08", "ovs_interfaceid": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3da329bb-7f6a-42ce-844f-752957fa87fc req-6613d15a-7925-4ba4-b355-336b824fa184 service nova] Releasing lock "refresh_cache-72c9428f-f797-46b4-9780-d2a4abb01ae7" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:05:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:21 user nova-compute[72815]: DEBUG nova.network.neutron [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Successfully updated port: 8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:05:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:05:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquired lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:05:21 user nova-compute[72815]: DEBUG nova.network.neutron [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:05:22 user nova-compute[72815]: DEBUG nova.network.neutron [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:05:22 user nova-compute[72815]: DEBUG nova.network.neutron [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updating instance_info_cache with network_info: [{"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Releasing lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:05:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Instance network_info: |[{"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:05:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-8af0efb7-5bff-4066-928d-92f85b00721d req-9227bcda-a6f5-467f-b9da-1c05ccaee7f8 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received event network-changed-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-8af0efb7-5bff-4066-928d-92f85b00721d req-9227bcda-a6f5-467f-b9da-1c05ccaee7f8 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Refreshing instance network info cache due to event network-changed-8eef4553-caa7-4c0f-93f3-bef2adb15e66. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:05:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8af0efb7-5bff-4066-928d-92f85b00721d req-9227bcda-a6f5-467f-b9da-1c05ccaee7f8 service nova] Acquiring lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:05:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8af0efb7-5bff-4066-928d-92f85b00721d req-9227bcda-a6f5-467f-b9da-1c05ccaee7f8 service nova] Acquired lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:05:22 user nova-compute[72815]: DEBUG nova.network.neutron [req-8af0efb7-5bff-4066-928d-92f85b00721d req-9227bcda-a6f5-467f-b9da-1c05ccaee7f8 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Refreshing network info cache for port 8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:05:23 user nova-compute[72815]: DEBUG nova.network.neutron [req-8af0efb7-5bff-4066-928d-92f85b00721d req-9227bcda-a6f5-467f-b9da-1c05ccaee7f8 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updated VIF entry in instance network info cache for port 8eef4553-caa7-4c0f-93f3-bef2adb15e66. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:05:23 user nova-compute[72815]: DEBUG nova.network.neutron [req-8af0efb7-5bff-4066-928d-92f85b00721d req-9227bcda-a6f5-467f-b9da-1c05ccaee7f8 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updating instance_info_cache with network_info: [{"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8af0efb7-5bff-4066-928d-92f85b00721d req-9227bcda-a6f5-467f-b9da-1c05ccaee7f8 service nova] Releasing lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG nova.objects.instance [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'flavor' on Instance uuid 72c9428f-f797-46b4-9780-d2a4abb01ae7 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:25 user nova-compute[72815]: INFO nova.compute.manager [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Attaching volume d12e820b-89b6-41bf-ab5f-f714a166bbd4 to /dev/vdb
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "1702dc0c-9333-4f16-937e-31beb1ea21fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG os_brick.utils [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2523c7f5-dda5-4815-9d51-80c8ae7b991d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:05:25 user nova-compute[72815]: INFO nova.compute.claims [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Claim successful on node user
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4a576e-9d0c-4748-9d2b-ae1bd3656855]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e60083-ecb6-4398-893f-0855d54861bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3279c18c-4eb7-4ec6-8ca6-be4a7bdc853b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:05:25 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:05:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7a7f93-dd84-4862-b7d1-5c21ef77acf7]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG os_brick.utils [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:05:25 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Updating existing volume attachment record: aaba06f9-5aab-497a-a871-e03e3c43dc79 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:05:26 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302711.171857, ee4a8248-9abc-45b3-9bf6-349c4d11f189 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:05:26 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] VM Stopped (Lifecycle Event)
Aug 17 20:05:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-cd7d9035-41ac-45fc-9f1a-7e3f1b67d46c None None] [instance: ee4a8248-9abc-45b3-9bf6-349c4d11f189] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:26 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:05:26 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:05:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:05:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:05:26 user nova-compute[72815]: DEBUG nova.network.neutron [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:05:26 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:05:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:05:26 user nova-compute[72815]: INFO nova.virt.block_device [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Booting with volume snapshot ad106812-4c63-446e-8f65-3c6e864d7a9f at /dev/vda
Aug 17 20:05:26 user nova-compute[72815]: DEBUG nova.policy [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '577ed0692a254a2fbd518e258563447f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78ad2cbee8e4db892ab66d619e0e42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:05:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.network.neutron [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Successfully created port: 53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.compute.manager [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:05:27 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Creating image(s)
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Ensure instance console log exists: /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Start _get_guest_xml network_info=[{"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': 'ed1a6328-4701-4472-a844-145df1b65fb6', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaCkUeRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'caffa446-5b29-4c5d-b756-4cc7119676cf', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9f313bf-5497-49a4-836b-79e22cbf75a2', 'serial': 'e9f313bf-5497-49a4-836b-79e22cbf75a2'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:05:27 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:05:27 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaCkUeRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:05:27 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:05:27 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:05:27 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9edec9-5925-4e21-8508-7f55a88c3f85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:05:27 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dde2f64-135f-43af-84e6-7fdc3dd1cb10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2] added
Aug 17 20:05:27 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78944e5-fae6-4963-8f79-ef986c5517ed]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0bdb12-4bd1-4cb6-aa5e-2ec4055fb78e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaCkUeRE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaCkUeRE" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c1e7fb-8d9e-414e-809d-9f4c6c153fbb]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JaCkUeRE'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5516d030-b1d1-4676-a6b0-c7c62aa2b3f2]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c55888-fec1-4b18-aaec-1358d7f0dbc2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:27 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:05:27 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:27 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:05:27 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:05:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d0b427-24b1-4a24-84f8-790be60f7a92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2, portal: 172.16.0.220,3260]
Aug 17 20:05:28 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2, portal: 172.16.0.220,3260] successful.
Aug 17 20:05:28 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc76f6b-79e1-4ce4-8c7d-b5f1095c182f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[963153cb-50f9-43cc-9ec1-1271f42501bd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:28 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:05:28 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:28 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:28 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:05:28 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:28 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eb6ae2-16f8-4442-9f81-9b4f53c180d0]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaCkUeRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG nova.network.neutron [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Successfully updated port: 53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "refresh_cache-1702dc0c-9333-4f16-937e-31beb1ea21fe" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquired lock "refresh_cache-1702dc0c-9333-4f16-937e-31beb1ea21fe" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG nova.network.neutron [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-dbc4eb9b-fcae-4f77-938c-f98df63dd964 req-57dda686-4312-4404-9b97-320b77d54a45 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received event network-changed-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-dbc4eb9b-fcae-4f77-938c-f98df63dd964 req-57dda686-4312-4404-9b97-320b77d54a45 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Refreshing instance network info cache due to event network-changed-53829955-ed05-4986-b1e9-9bad4ac89908. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dbc4eb9b-fcae-4f77-938c-f98df63dd964 req-57dda686-4312-4404-9b97-320b77d54a45 service nova] Acquiring lock "refresh_cache-1702dc0c-9333-4f16-937e-31beb1ea21fe" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG nova.network.neutron [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG nova.network.neutron [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Updating instance_info_cache with network_info: [{"id": "53829955-ed05-4986-b1e9-9bad4ac89908", "address": "fa:16:3e:04:f9:75", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53829955-ed", "ovs_interfaceid": "53829955-ed05-4986-b1e9-9bad4ac89908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Releasing lock "refresh_cache-1702dc0c-9333-4f16-937e-31beb1ea21fe" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Instance network_info: |[{"id": "53829955-ed05-4986-b1e9-9bad4ac89908", "address": "fa:16:3e:04:f9:75", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53829955-ed", "ovs_interfaceid": "53829955-ed05-4986-b1e9-9bad4ac89908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dbc4eb9b-fcae-4f77-938c-f98df63dd964 req-57dda686-4312-4404-9b97-320b77d54a45 service nova] Acquired lock "refresh_cache-1702dc0c-9333-4f16-937e-31beb1ea21fe" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:05:28 user nova-compute[72815]: DEBUG nova.network.neutron [req-dbc4eb9b-fcae-4f77-938c-f98df63dd964 req-57dda686-4312-4404-9b97-320b77d54a45 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Refreshing network info cache for port 53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.network.neutron [req-dbc4eb9b-fcae-4f77-938c-f98df63dd964 req-57dda686-4312-4404-9b97-320b77d54a45 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Updated VIF entry in instance network info cache for port 53829955-ed05-4986-b1e9-9bad4ac89908. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.network.neutron [req-dbc4eb9b-fcae-4f77-938c-f98df63dd964 req-57dda686-4312-4404-9b97-320b77d54a45 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Updating instance_info_cache with network_info: [{"id": "53829955-ed05-4986-b1e9-9bad4ac89908", "address": "fa:16:3e:04:f9:75", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53829955-ed", "ovs_interfaceid": "53829955-ed05-4986-b1e9-9bad4ac89908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dbc4eb9b-fcae-4f77-938c-f98df63dd964 req-57dda686-4312-4404-9b97-320b77d54a45 service nova] Releasing lock "refresh_cache-1702dc0c-9333-4f16-937e-31beb1ea21fe" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26135386362616236', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135386362616236', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1142280768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1142280768',id=27,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-xdar94bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:05:05Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=caffa446-5b29-4c5d-b756-4cc7119676cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:fd:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdd534e6-dcf7-4ddc-8654-5140e12727b0,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd534e6-dc') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.objects.instance [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'pci_devices' on Instance uuid caffa446-5b29-4c5d-b756-4cc7119676cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:05:29 user nova-compute[72815]:   <uuid>caffa446-5b29-4c5d-b756-4cc7119676cf</uuid>
Aug 17 20:05:29 user nova-compute[72815]:   <name>instance-0000001b</name>
Aug 17 20:05:29 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:05:29 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:05:29 user nova-compute[72815]:   <metadata>
Aug 17 20:05:29 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:05:29 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:05:29 user nova-compute[72815]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1142280768</nova:name>
Aug 17 20:05:29 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:05:27</nova:creationTime>
Aug 17 20:05:29 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:05:29 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:05:29 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:05:29 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:05:29 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:05:29 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:05:29 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:05:29 user nova-compute[72815]:       <nova:owner>
Aug 17 20:05:29 user nova-compute[72815]:         <nova:user uuid="169121564e514d4f883b71abeb3e6070">tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member</nova:user>
Aug 17 20:05:29 user nova-compute[72815]:         <nova:project uuid="89c20bd5232b4b058abc1b50f38cade3">tempest-ServerBootFromVolumeStableRescueTest-264619992</nova:project>
Aug 17 20:05:29 user nova-compute[72815]:       </nova:owner>
Aug 17 20:05:29 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:05:29 user nova-compute[72815]:       <nova:ports>
Aug 17 20:05:29 user nova-compute[72815]:         <nova:port uuid="cdd534e6-dcf7-4ddc-8654-5140e12727b0">
Aug 17 20:05:29 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 20:05:29 user nova-compute[72815]:         </nova:port>
Aug 17 20:05:29 user nova-compute[72815]:       </nova:ports>
Aug 17 20:05:29 user nova-compute[72815]:     </nova:instance>
Aug 17 20:05:29 user nova-compute[72815]:   </metadata>
Aug 17 20:05:29 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:05:29 user nova-compute[72815]:     <system>
Aug 17 20:05:29 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:05:29 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:05:29 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:05:29 user nova-compute[72815]:       <entry name="serial">caffa446-5b29-4c5d-b756-4cc7119676cf</entry>
Aug 17 20:05:29 user nova-compute[72815]:       <entry name="uuid">caffa446-5b29-4c5d-b756-4cc7119676cf</entry>
Aug 17 20:05:29 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:05:29 user nova-compute[72815]:     </system>
Aug 17 20:05:29 user nova-compute[72815]:   </sysinfo>
Aug 17 20:05:29 user nova-compute[72815]:   <os>
Aug 17 20:05:29 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:05:29 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:05:29 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:05:29 user nova-compute[72815]:   </os>
Aug 17 20:05:29 user nova-compute[72815]:   <features>
Aug 17 20:05:29 user nova-compute[72815]:     <acpi/>
Aug 17 20:05:29 user nova-compute[72815]:     <apic/>
Aug 17 20:05:29 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:05:29 user nova-compute[72815]:   </features>
Aug 17 20:05:29 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:05:29 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:05:29 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:05:29 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:05:29 user nova-compute[72815]:   </clock>
Aug 17 20:05:29 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:05:29 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:05:29 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:05:29 user nova-compute[72815]:   </cpu>
Aug 17 20:05:29 user nova-compute[72815]:   <devices>
Aug 17 20:05:29 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:05:29 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:05:29 user nova-compute[72815]:       <source dev="/dev/sdb"/>
Aug 17 20:05:29 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:05:29 user nova-compute[72815]:       <serial>e9f313bf-5497-49a4-836b-79e22cbf75a2</serial>
Aug 17 20:05:29 user nova-compute[72815]:     </disk>
Aug 17 20:05:29 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:05:29 user nova-compute[72815]:       <mac address="fa:16:3e:45:fd:f8"/>
Aug 17 20:05:29 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:05:29 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:05:29 user nova-compute[72815]:       <target dev="tapcdd534e6-dc"/>
Aug 17 20:05:29 user nova-compute[72815]:     </interface>
Aug 17 20:05:29 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:05:29 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/console.log" append="off"/>
Aug 17 20:05:29 user nova-compute[72815]:     </serial>
Aug 17 20:05:29 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:05:29 user nova-compute[72815]:     <video>
Aug 17 20:05:29 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:05:29 user nova-compute[72815]:     </video>
Aug 17 20:05:29 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:05:29 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:05:29 user nova-compute[72815]:     </rng>
Aug 17 20:05:29 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:05:29 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:05:29 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:05:29 user nova-compute[72815]:     </memballoon>
Aug 17 20:05:29 user nova-compute[72815]:   </devices>
Aug 17 20:05:29 user nova-compute[72815]: </domain>
Aug 17 20:05:29 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1142280768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1142280768',id=27,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-xdar94bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:05:05Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=caffa446-5b29-4c5d-b756-4cc7119676cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:fd:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdd534e6-dcf7-4ddc-8654-5140e12727b0,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd534e6-dc') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG os_vif [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:fd:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdd534e6-dcf7-4ddc-8654-5140e12727b0,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd534e6-dc') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdd534e6-dc, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcdd534e6-dc, col_values=(('external_ids', {'iface-id': 'cdd534e6-dcf7-4ddc-8654-5140e12727b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:fd:f8', 'vm-uuid': 'caffa446-5b29-4c5d-b756-4cc7119676cf'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:29 user nova-compute[72815]: INFO os_vif [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:fd:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdd534e6-dcf7-4ddc-8654-5140e12727b0,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd534e6-dc')
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No VIF found with MAC fa:16:3e:45:fd:f8, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:29 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:05:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-e15b41c5-4b70-4f7e-81c0-61d35000e017 req-ef0ea24a-0ed2-4afc-b1e6-85c3207bc6be service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e15b41c5-4b70-4f7e-81c0-61d35000e017 req-ef0ea24a-0ed2-4afc-b1e6-85c3207bc6be service nova] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e15b41c5-4b70-4f7e-81c0-61d35000e017 req-ef0ea24a-0ed2-4afc-b1e6-85c3207bc6be service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e15b41c5-4b70-4f7e-81c0-61d35000e017 req-ef0ea24a-0ed2-4afc-b1e6-85c3207bc6be service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-e15b41c5-4b70-4f7e-81c0-61d35000e017 req-ef0ea24a-0ed2-4afc-b1e6-85c3207bc6be service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] No waiting events found dispatching network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:30 user nova-compute[72815]: WARNING nova.compute.manager [req-e15b41c5-4b70-4f7e-81c0-61d35000e017 req-ef0ea24a-0ed2-4afc-b1e6-85c3207bc6be service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received unexpected event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 for instance with vm_state building and task_state spawning.
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:05:31 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Creating image(s)
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Ensure instance console log exists: /opt/stack/data/nova/instances/4c630764-4e1b-4bab-b354-1389cd60f5a5/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Start _get_guest_xml network_info=[{"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '5162331b-32ac-45d4-bc7f-c8da8e6c60f9', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytbPpMxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c630764-4e1b-4bab-b354-1389cd60f5a5', 'attached_at': '', 'detached_at': '', 'volume_id': '228e179c-97dd-4ee6-978b-4450933aa2c9', 'serial': '228e179c-97dd-4ee6-978b-4450933aa2c9'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:05:31 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:05:31 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytbPpMxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:05:31 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:05:31 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:05:31 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b06026f-f8dc-428d-bc9f-6d8febb7554c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:05:31 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50c05d1-352e-4888-81da-b56002035757]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9] added
Aug 17 20:05:31 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8effaaa7-e8b9-4457-8655-383e18ea1f01]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cc5299-46c9-4984-8e07-81b98c475202]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytbPpMxJ {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytbPpMxJ" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edd22c3-4146-41a4-ab22-f1c5a719e271]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ytbPpMxJ'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd1cc1d-670f-4e05-87e9-1803c3ad4983]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf4e52e-5625-4ed3-b1f7-d4c43f3804a1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:31 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:05:31 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:31 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:31 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:05:31 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:31 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[42abe5d1-198a-4e90-9de2-a829726d3007]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260]
Aug 17 20:05:31 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260] successful.
Aug 17 20:05:31 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[651541c1-f273-49d2-80dd-477fac7f35cd]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[979b9049-b0ae-4213-b881-5d1a393cfb99]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:31 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:05:31 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:31 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:05:31 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:31 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:05:31 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:31 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:05:31 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a226dad4-ee7d-4743-aa99-32490e5829f5]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytbPpMxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23165333239373766', 'path': '/dev/sdd'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165333239373766', 'path': '/dev/sdd'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-860044542',display_name='tempest-ServerActionsTestOtherA-server-860044542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-860044542',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4ENuaMW9sQVv3tRQvGXO2rdSecjVcsBbTS05/ZUuaQNEEpkOe2HF0EHrSzQ0+4hhL3IgPXmkF5ZxUJ6bIwwpVvvT5kiu8Xp5gaO6UacRTK/fZorahpTHXq4z54fcfMBQ==',key_name='tempest-keypair-1973140313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-o2ttr69y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=4c630764-4e1b-4bab-b354-1389cd60f5a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.objects.instance [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c630764-4e1b-4bab-b354-1389cd60f5a5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:05:32 user nova-compute[72815]:   <uuid>4c630764-4e1b-4bab-b354-1389cd60f5a5</uuid>
Aug 17 20:05:32 user nova-compute[72815]:   <name>instance-0000001c</name>
Aug 17 20:05:32 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:05:32 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:05:32 user nova-compute[72815]:   <metadata>
Aug 17 20:05:32 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:05:32 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:05:32 user nova-compute[72815]:       <nova:name>tempest-ServerActionsTestOtherA-server-860044542</nova:name>
Aug 17 20:05:32 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:05:31</nova:creationTime>
Aug 17 20:05:32 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:05:32 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:05:32 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:05:32 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:05:32 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:05:32 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:05:32 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:05:32 user nova-compute[72815]:       <nova:owner>
Aug 17 20:05:32 user nova-compute[72815]:         <nova:user uuid="9821282c73174c448f7fca6b65676f61">tempest-ServerActionsTestOtherA-629489909-project-member</nova:user>
Aug 17 20:05:32 user nova-compute[72815]:         <nova:project uuid="a0708d4f49ed4c96b108d1d2aff76871">tempest-ServerActionsTestOtherA-629489909</nova:project>
Aug 17 20:05:32 user nova-compute[72815]:       </nova:owner>
Aug 17 20:05:32 user nova-compute[72815]:       <nova:ports>
Aug 17 20:05:32 user nova-compute[72815]:         <nova:port uuid="8eef4553-caa7-4c0f-93f3-bef2adb15e66">
Aug 17 20:05:32 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 20:05:32 user nova-compute[72815]:         </nova:port>
Aug 17 20:05:32 user nova-compute[72815]:       </nova:ports>
Aug 17 20:05:32 user nova-compute[72815]:     </nova:instance>
Aug 17 20:05:32 user nova-compute[72815]:   </metadata>
Aug 17 20:05:32 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:05:32 user nova-compute[72815]:     <system>
Aug 17 20:05:32 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:05:32 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:05:32 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:05:32 user nova-compute[72815]:       <entry name="serial">4c630764-4e1b-4bab-b354-1389cd60f5a5</entry>
Aug 17 20:05:32 user nova-compute[72815]:       <entry name="uuid">4c630764-4e1b-4bab-b354-1389cd60f5a5</entry>
Aug 17 20:05:32 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:05:32 user nova-compute[72815]:     </system>
Aug 17 20:05:32 user nova-compute[72815]:   </sysinfo>
Aug 17 20:05:32 user nova-compute[72815]:   <os>
Aug 17 20:05:32 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:05:32 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:05:32 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:05:32 user nova-compute[72815]:   </os>
Aug 17 20:05:32 user nova-compute[72815]:   <features>
Aug 17 20:05:32 user nova-compute[72815]:     <acpi/>
Aug 17 20:05:32 user nova-compute[72815]:     <apic/>
Aug 17 20:05:32 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:05:32 user nova-compute[72815]:   </features>
Aug 17 20:05:32 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:05:32 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:05:32 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:05:32 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:05:32 user nova-compute[72815]:   </clock>
Aug 17 20:05:32 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:05:32 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:05:32 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:05:32 user nova-compute[72815]:   </cpu>
Aug 17 20:05:32 user nova-compute[72815]:   <devices>
Aug 17 20:05:32 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:05:32 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:05:32 user nova-compute[72815]:       <source dev="/dev/sdd"/>
Aug 17 20:05:32 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:05:32 user nova-compute[72815]:       <serial>228e179c-97dd-4ee6-978b-4450933aa2c9</serial>
Aug 17 20:05:32 user nova-compute[72815]:     </disk>
Aug 17 20:05:32 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:05:32 user nova-compute[72815]:       <mac address="fa:16:3e:27:4e:31"/>
Aug 17 20:05:32 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:05:32 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:05:32 user nova-compute[72815]:       <target dev="tap8eef4553-ca"/>
Aug 17 20:05:32 user nova-compute[72815]:     </interface>
Aug 17 20:05:32 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:05:32 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/4c630764-4e1b-4bab-b354-1389cd60f5a5/console.log" append="off"/>
Aug 17 20:05:32 user nova-compute[72815]:     </serial>
Aug 17 20:05:32 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:05:32 user nova-compute[72815]:     <video>
Aug 17 20:05:32 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:05:32 user nova-compute[72815]:     </video>
Aug 17 20:05:32 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:05:32 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:05:32 user nova-compute[72815]:     </rng>
Aug 17 20:05:32 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:05:32 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:05:32 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:05:32 user nova-compute[72815]:     </memballoon>
Aug 17 20:05:32 user nova-compute[72815]:   </devices>
Aug 17 20:05:32 user nova-compute[72815]: </domain>
Aug 17 20:05:32 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-860044542',display_name='tempest-ServerActionsTestOtherA-server-860044542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-860044542',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4ENuaMW9sQVv3tRQvGXO2rdSecjVcsBbTS05/ZUuaQNEEpkOe2HF0EHrSzQ0+4hhL3IgPXmkF5ZxUJ6bIwwpVvvT5kiu8Xp5gaO6UacRTK/fZorahpTHXq4z54fcfMBQ==',key_name='tempest-keypair-1973140313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-o2ttr69y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=4c630764-4e1b-4bab-b354-1389cd60f5a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG os_vif [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eef4553-ca, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8eef4553-ca, col_values=(('external_ids', {'iface-id': '8eef4553-caa7-4c0f-93f3-bef2adb15e66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:4e:31', 'vm-uuid': '4c630764-4e1b-4bab-b354-1389cd60f5a5'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:32 user nova-compute[72815]: INFO os_vif [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca')
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No VIF found with MAC fa:16:3e:27:4e:31, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302732.796892, caffa446-5b29-4c5d-b756-4cc7119676cf => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:05:32 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] VM Resumed (Lifecycle Event)
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:32 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Instance spawned successfully.
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:32 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302732.7973807, caffa446-5b29-4c5d-b756-4cc7119676cf => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:05:32 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] VM Started (Lifecycle Event)
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:05:32 user nova-compute[72815]: INFO nova.compute.manager [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Took 5.27 seconds to spawn the instance on the hypervisor.
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:32 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.compute.manager [req-1aeb65ed-6e31-4f14-b9de-d34c9960db2d req-565c9ca1-f32d-44c3-b95c-160e8d633a19 service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1aeb65ed-6e31-4f14-b9de-d34c9960db2d req-565c9ca1-f32d-44c3-b95c-160e8d633a19 service nova] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1aeb65ed-6e31-4f14-b9de-d34c9960db2d req-565c9ca1-f32d-44c3-b95c-160e8d633a19 service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1aeb65ed-6e31-4f14-b9de-d34c9960db2d req-565c9ca1-f32d-44c3-b95c-160e8d633a19 service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:32 user nova-compute[72815]: DEBUG nova.compute.manager [req-1aeb65ed-6e31-4f14-b9de-d34c9960db2d req-565c9ca1-f32d-44c3-b95c-160e8d633a19 service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] No waiting events found dispatching network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:32 user nova-compute[72815]: WARNING nova.compute.manager [req-1aeb65ed-6e31-4f14-b9de-d34c9960db2d req-565c9ca1-f32d-44c3-b95c-160e8d633a19 service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received unexpected event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 for instance with vm_state building and task_state spawning.
Aug 17 20:05:33 user nova-compute[72815]: INFO nova.compute.manager [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Took 28.86 seconds to build instance.
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-98893fac-42c9-45aa-bc17-12dbbb36dd0e tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.964s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG os_brick.utils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[924d96dd-1088-4794-9856-ea1b916e6882]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ce970b-c83e-4c4c-a14b-3957312220f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67885e0-e682-4a24-b7eb-c95a671018b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bdd1e8-0405-46e7-86e7-c7f05fae4859]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:05:33 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea54a60-202d-47cd-9dce-db9324223445]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG os_brick.utils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Updating existing volume attachment record: 0ae02d5d-53b9-4db2-bb83-47b58d3094d2 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-c7a535a8-5c92-4861-8dd0-826046280bc7 req-37910205-159b-40d0-9df3-edbf96b3f319 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received event network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c7a535a8-5c92-4861-8dd0-826046280bc7 req-37910205-159b-40d0-9df3-edbf96b3f319 service nova] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c7a535a8-5c92-4861-8dd0-826046280bc7 req-37910205-159b-40d0-9df3-edbf96b3f319 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c7a535a8-5c92-4861-8dd0-826046280bc7 req-37910205-159b-40d0-9df3-edbf96b3f319 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-c7a535a8-5c92-4861-8dd0-826046280bc7 req-37910205-159b-40d0-9df3-edbf96b3f319 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] No waiting events found dispatching network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:35 user nova-compute[72815]: WARNING nova.compute.manager [req-c7a535a8-5c92-4861-8dd0-826046280bc7 req-37910205-159b-40d0-9df3-edbf96b3f319 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received unexpected event network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 for instance with vm_state building and task_state spawning.
Aug 17 20:05:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-c7a535a8-5c92-4861-8dd0-826046280bc7 req-37910205-159b-40d0-9df3-edbf96b3f319 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received event network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c7a535a8-5c92-4861-8dd0-826046280bc7 req-37910205-159b-40d0-9df3-edbf96b3f319 service nova] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c7a535a8-5c92-4861-8dd0-826046280bc7 req-37910205-159b-40d0-9df3-edbf96b3f319 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c7a535a8-5c92-4861-8dd0-826046280bc7 req-37910205-159b-40d0-9df3-edbf96b3f319 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-c7a535a8-5c92-4861-8dd0-826046280bc7 req-37910205-159b-40d0-9df3-edbf96b3f319 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] No waiting events found dispatching network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:35 user nova-compute[72815]: WARNING nova.compute.manager [req-c7a535a8-5c92-4861-8dd0-826046280bc7 req-37910205-159b-40d0-9df3-edbf96b3f319 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received unexpected event network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 for instance with vm_state building and task_state spawning.
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302736.5261214, 4c630764-4e1b-4bab-b354-1389cd60f5a5 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:05:36 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] VM Resumed (Lifecycle Event)
Aug 17 20:05:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:05:36 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:05:36 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7338MB free_disk=25.359859466552734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:36 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Instance spawned successfully.
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:36 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302736.5304606, 4c630764-4e1b-4bab-b354-1389cd60f5a5 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:05:36 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] VM Started (Lifecycle Event)
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:05:36 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:05:36 user nova-compute[72815]: INFO nova.compute.manager [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Took 5.68 seconds to spawn the instance on the hypervisor.
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 3a4f27f3-4573-43b5-827a-bbdae4ebce10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 71e8c292-6412-4079-8a2c-11c65c808588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 12a34846-1670-4c6c-ac7d-522530aaf3a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 72c9428f-f797-46b4-9780-d2a4abb01ae7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance fa0a87a2-9816-4aed-901d-1dff953f8046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance caffa446-5b29-4c5d-b756-4cc7119676cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 4c630764-4e1b-4bab-b354-1389cd60f5a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1702dc0c-9333-4f16-937e-31beb1ea21fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:05:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:05:36 user nova-compute[72815]: INFO nova.compute.manager [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Took 18.75 seconds to build instance.
Aug 17 20:05:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aacc4b36-fffd-47a0-85a5-13b3ddde107f tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.852s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:37 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:05:37 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:05:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:05:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.691s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:37 user nova-compute[72815]: INFO nova.compute.manager [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Terminating instance
Aug 17 20:05:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-890a76bc-dc2e-4602-906b-9f7dfce58af0 req-edd7bc97-a535-420a-9a12-83747cffafba service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-unplugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-890a76bc-dc2e-4602-906b-9f7dfce58af0 req-edd7bc97-a535-420a-9a12-83747cffafba service nova] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-890a76bc-dc2e-4602-906b-9f7dfce58af0 req-edd7bc97-a535-420a-9a12-83747cffafba service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-890a76bc-dc2e-4602-906b-9f7dfce58af0 req-edd7bc97-a535-420a-9a12-83747cffafba service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-890a76bc-dc2e-4602-906b-9f7dfce58af0 req-edd7bc97-a535-420a-9a12-83747cffafba service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] No waiting events found dispatching network-vif-unplugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-890a76bc-dc2e-4602-906b-9f7dfce58af0 req-edd7bc97-a535-420a-9a12-83747cffafba service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-unplugged-e936e6d3-48e1-4322-b2d4-779037eff32c for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:05:38 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Instance destroyed successfully.
Aug 17 20:05:38 user nova-compute[72815]: DEBUG nova.objects.instance [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lazy-loading 'resources' on Instance uuid 3a4f27f3-4573-43b5-827a-bbdae4ebce10 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-468217050',display_name='tempest-ServerActionsTestOtherB-server-468217050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-468217050',id=14,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpS9twCAKB9Qcxa77kKBv1mcMWNNwvJ8PtuQNagNxi+2wHS7dCki+1ibMc73BH5JCIYY5sRP3ThGzFZPpzGom37joOakxOGFFMKzFdXVL+/I3uzE68ATLp8T4Wn8HgTCg==',key_name='tempest-keypair-1805104337',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:03:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f0bfaa4f27c4bf1bf6be9b74b9f8a09',ramdisk_id='',reservation_id='r-8y7ruqfi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-166537402',owner_user_name='tempest-ServerActionsTestOtherB-166537402-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:03:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03912162ae0f4b299c8c7b044b61798f',uuid=3a4f27f3-4573-43b5-827a-bbdae4ebce10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converting VIF {"id": "e936e6d3-48e1-4322-b2d4-779037eff32c", "address": "fa:16:3e:7f:6e:78", "network": {"id": "e371f80e-06e4-46da-90b0-c5ef3b01e56e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1239391925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f0bfaa4f27c4bf1bf6be9b74b9f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape936e6d3-48", "ovs_interfaceid": "e936e6d3-48e1-4322-b2d4-779037eff32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG os_vif [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape936e6d3-48, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:05:38 user nova-compute[72815]: INFO os_vif [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=e936e6d3-48e1-4322-b2d4-779037eff32c,network=Network(e371f80e-06e4-46da-90b0-c5ef3b01e56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape936e6d3-48')
Aug 17 20:05:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrhyWBRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:05:38 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:05:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[006dbbb7-fad8-41a7-aad8-0af536d71bab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d56e8c9-e780-4567-ad94-36c89315df60]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:38 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:05:38 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:38 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:05:38 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:38 user nova-compute[72815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 (non-flash)
Aug 17 20:05:38 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:38 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:05:38 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399449f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094'): ({'sdg'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Removing single pathed devices sdg {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:05:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3bd46e-6410-4e69-8c69-0357d4a30d91]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8b4e2e-542e-4ae8-a006-e3e7baaa1c50]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Flushing IO for device /dev/sdg {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4da09e-4caf-4c03-879f-66b768724de3]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[92104526-8f9c-4fc5-9ecf-9f108dec1739]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] SCSI volumes sdg have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[29806635-b092-4751-92d1-bb8fd9ef48c4]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2735cee0-b26b-4414-a09a-6d3f315cb03a]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260]
Aug 17 20:05:39 user nova-compute[72815]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094, portal: 172.16.0.220,3260] successful.
Aug 17 20:05:39 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30b8cda4-cfa8-47e8-bed3-21de5c735094 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4be6af-d7cf-4945-a7ac-c10c4e538e53]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] <== disconnect_volume: return (332ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:05:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Deleting instance files /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10_del
Aug 17 20:05:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Deletion of /opt/stack/data/nova/instances/3a4f27f3-4573-43b5-827a-bbdae4ebce10_del complete
Aug 17 20:05:39 user nova-compute[72815]: INFO nova.compute.manager [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Took 1.36 seconds to destroy the instance on the hypervisor.
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Skipping network cache update for instance because it is being deleted. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtmIoRpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:05:39 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:05:39 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:05:39 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[901f3277-360d-4dba-8aee-11b69e7bbf78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:05:39 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab98b1a0-ec52-4ce8-9b6e-41ca3fafee99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4] added
Aug 17 20:05:39 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafafec7-3c99-41e1-b98a-d59d4ce2b917]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[abee1baa-7676-4e42-baad-696fdd4d7c2e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FtmIoRpW {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FtmIoRpW" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cc8de4-0035-42b7-81ae-a4ffffc33ebe]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FtmIoRpW'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1395fba-43d2-4498-9912-93f72b31afb0]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd889d8-4474-4fc0-b876-476d73194bff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:40 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:40 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:05:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:40 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:40 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:05:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8331bd02-a9ea-4be9-9650-33adb43f3966]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4, portal: 172.16.0.220,3260]
Aug 17 20:05:40 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4, portal: 172.16.0.220,3260] successful.
Aug 17 20:05:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d2cfee-faa6-403f-ba15-b1c77d64ee28]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d688b0-98c0-4dfd-9ddc-429884d56348]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:40 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:40 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:05:40 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:05:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:40 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:40 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:05:40 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:05:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Updating instance_info_cache with network_info: [{"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[194d8016-9fe6-40d6-9f1c-6d6dd472325e]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:40 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Took 0.99 seconds to deallocate network for instance.
Aug 17 20:05:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-d534cbb8-9b8a-4945-9b7e-e5ec63b1805c req-8719d0c1-86ca-4fb5-958e-01933f0ad865 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d534cbb8-9b8a-4945-9b7e-e5ec63b1805c req-8719d0c1-86ca-4fb5-958e-01933f0ad865 service nova] Acquiring lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d534cbb8-9b8a-4945-9b7e-e5ec63b1805c req-8719d0c1-86ca-4fb5-958e-01933f0ad865 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d534cbb8-9b8a-4945-9b7e-e5ec63b1805c req-8719d0c1-86ca-4fb5-958e-01933f0ad865 service nova] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-d534cbb8-9b8a-4945-9b7e-e5ec63b1805c req-8719d0c1-86ca-4fb5-958e-01933f0ad865 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] No waiting events found dispatching network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:40 user nova-compute[72815]: WARNING nova.compute.manager [req-d534cbb8-9b8a-4945-9b7e-e5ec63b1805c req-8719d0c1-86ca-4fb5-958e-01933f0ad865 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received unexpected event network-vif-plugged-e936e6d3-48e1-4322-b2d4-779037eff32c for instance with vm_state active and task_state deleting.
Aug 17 20:05:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-d534cbb8-9b8a-4945-9b7e-e5ec63b1805c req-8719d0c1-86ca-4fb5-958e-01933f0ad865 service nova] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Received event network-vif-deleted-e936e6d3-48e1-4322-b2d4-779037eff32c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:41 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:05:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtmIoRpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:05:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:05:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23661623333303038', 'path': '/dev/sde'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:05:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661623333303038', 'path': '/dev/sde'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:05:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'flavor' on Instance uuid 72c9428f-f797-46b4-9780-d2a4abb01ae7 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:05:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:05:41 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:05:41 user nova-compute[72815]:   <source dev="/dev/sde"/>
Aug 17 20:05:41 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:05:41 user nova-compute[72815]:   <serial>d12e820b-89b6-41bf-ab5f-f714a166bbd4</serial>
Aug 17 20:05:41 user nova-compute[72815]: </disk>
Aug 17 20:05:41 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:05:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:05:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:05:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No VIF found with MAC fa:16:3e:ba:2a:d7, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:05:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-57d74a2e-881c-41f5-9fd8-919fcdaa5a7f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.129s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "634e7522-f51c-4556-827f-18ec5fee230a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "634e7522-f51c-4556-827f-18ec5fee230a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:05:46 user nova-compute[72815]: INFO nova.compute.claims [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Claim successful on node user
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:05:46 user nova-compute[72815]: INFO nova.compute.manager [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Took 6.49 seconds to detach 1 volumes for instance.
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:05:46 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Creating image(s)
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Ensure instance console log exists: /opt/stack/data/nova/instances/1702dc0c-9333-4f16-937e-31beb1ea21fe/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Start _get_guest_xml network_info=[{"id": "53829955-ed05-4986-b1e9-9bad4ac89908", "address": "fa:16:3e:04:f9:75", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53829955-ed", "ovs_interfaceid": "53829955-ed05-4986-b1e9-9bad4ac89908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '0ae02d5d-53b9-4db2-bb83-47b58d3094d2', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVfykuEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1702dc0c-9333-4f16-937e-31beb1ea21fe', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8af8963-9af0-4e7e-be96-cb1b5313fb25', 'serial': 'b8af8963-9af0-4e7e-be96-cb1b5313fb25'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:05:46 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:05:46 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:05:46 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVfykuEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:05:46 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:05:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:05:46 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:05:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:05:46 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bc668d-cfb3-4b20-8ce2-0d2c68860e44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:05:46 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a58e99-8e5d-4326-aa87-cb78e510b937]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25] added
Aug 17 20:05:46 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:46 user nova-compute[72815]: DEBUG nova.policy [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a75e05392d54cfb9fcda786e3ee2efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9b4cae7404f3184fc480ffddfbbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c43e3dc-efb1-40c9-a337-a66fcaf8ec8a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3871925f-2058-4af1-b9f8-f9849eb072bf]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SVfykuEK {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:05:47 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Creating image(s)
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "/opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "/opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "/opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SVfykuEK" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[03295d19-064c-4efd-9922-2082aed9ed5e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SVfykuEK'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[206a3223-f693-4376-975b-200d69132560]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8fd0d6-b893-4f77-9b27-8125b22a5f03]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:47 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:47 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:05:47 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:05:47 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:47 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:47 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:05:47 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:05:47 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.226s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk 1073741824" returned: 0 in 0.121s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.892s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:47 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Deleted allocations for instance 3a4f27f3-4573-43b5-827a-bbdae4ebce10
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.216s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-391445bc-c064-4107-b054-38d73d7ef77a tempest-ServerActionsTestOtherB-166537402 tempest-ServerActionsTestOtherB-166537402-project-member] Lock "3a4f27f3-4573-43b5-827a-bbdae4ebce10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.057s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Cannot resize image /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'migration_context' on Instance uuid 634e7522-f51c-4556-827f-18ec5fee230a {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Ensure instance console log exists: /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Successfully created port: 6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --login" returned: 0 in 1.096s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d170939-a50b-48fb-8eca-469f996cb32d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25, portal: 172.16.0.220,3260]
Aug 17 20:05:48 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25, portal: 172.16.0.220,3260] successful.
Aug 17 20:05:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03bc49d-21d6-469f-a38c-e1ece6796f22]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[434ce105-cdfe-465a-8035-41b3b20182ab]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:48 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:48 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:05:48 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:05:48 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:05:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:05:48 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:05:48 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:05:48 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:05:48 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:05:48 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.418s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d55156b-91e3-44c1-b261-846d44a3d779]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:05:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Successfully updated port: 6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "refresh_cache-634e7522-f51c-4556-827f-18ec5fee230a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquired lock "refresh_cache-634e7522-f51c-4556-827f-18ec5fee230a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-05b3d275-cae5-4381-9d50-a48dd9e346fe req-cc029c2f-b237-4636-a1d8-3ab9211fb45f service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Received event network-changed-6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-05b3d275-cae5-4381-9d50-a48dd9e346fe req-cc029c2f-b237-4636-a1d8-3ab9211fb45f service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Refreshing instance network info cache due to event network-changed-6629ee00-d584-48cd-8e48-3567e19b2f5e. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-05b3d275-cae5-4381-9d50-a48dd9e346fe req-cc029c2f-b237-4636-a1d8-3ab9211fb45f service nova] Acquiring lock "refresh_cache-634e7522-f51c-4556-827f-18ec5fee230a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVfykuEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.450s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== connect_volume: return (2451ms) {'type': 'block', 'scsi_wwn': '23131326161373863', 'path': '/dev/sdf'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131326161373863', 'path': '/dev/sdf'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1062185546',display_name='tempest-TestVolumeBootPattern-server-1062185546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1062185546',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-yaix7ok0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:05:27Z,user_data=None,user_id='577ed0692a254a2fbd518e258563447f',uuid=1702dc0c-9333-4f16-937e-31beb1ea21fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53829955-ed05-4986-b1e9-9bad4ac89908", "address": "fa:16:3e:04:f9:75", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53829955-ed", "ovs_interfaceid": "53829955-ed05-4986-b1e9-9bad4ac89908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "53829955-ed05-4986-b1e9-9bad4ac89908", "address": "fa:16:3e:04:f9:75", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53829955-ed", "ovs_interfaceid": "53829955-ed05-4986-b1e9-9bad4ac89908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f9:75,bridge_name='br-int',has_traffic_filtering=True,id=53829955-ed05-4986-b1e9-9bad4ac89908,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53829955-ed') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.objects.instance [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lazy-loading 'pci_devices' on Instance uuid 1702dc0c-9333-4f16-937e-31beb1ea21fe {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:05:49 user nova-compute[72815]:   <uuid>1702dc0c-9333-4f16-937e-31beb1ea21fe</uuid>
Aug 17 20:05:49 user nova-compute[72815]:   <name>instance-0000001d</name>
Aug 17 20:05:49 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:05:49 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:05:49 user nova-compute[72815]:   <metadata>
Aug 17 20:05:49 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:05:49 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:05:49 user nova-compute[72815]:       <nova:name>tempest-TestVolumeBootPattern-server-1062185546</nova:name>
Aug 17 20:05:49 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:05:46</nova:creationTime>
Aug 17 20:05:49 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:05:49 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:05:49 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:05:49 user nova-compute[72815]:       <nova:owner>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:user uuid="577ed0692a254a2fbd518e258563447f">tempest-TestVolumeBootPattern-781314261-project-member</nova:user>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:project uuid="a78ad2cbee8e4db892ab66d619e0e42e">tempest-TestVolumeBootPattern-781314261</nova:project>
Aug 17 20:05:49 user nova-compute[72815]:       </nova:owner>
Aug 17 20:05:49 user nova-compute[72815]:       <nova:ports>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:port uuid="53829955-ed05-4986-b1e9-9bad4ac89908">
Aug 17 20:05:49 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 20:05:49 user nova-compute[72815]:         </nova:port>
Aug 17 20:05:49 user nova-compute[72815]:       </nova:ports>
Aug 17 20:05:49 user nova-compute[72815]:     </nova:instance>
Aug 17 20:05:49 user nova-compute[72815]:   </metadata>
Aug 17 20:05:49 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:05:49 user nova-compute[72815]:     <system>
Aug 17 20:05:49 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:05:49 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:05:49 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:05:49 user nova-compute[72815]:       <entry name="serial">1702dc0c-9333-4f16-937e-31beb1ea21fe</entry>
Aug 17 20:05:49 user nova-compute[72815]:       <entry name="uuid">1702dc0c-9333-4f16-937e-31beb1ea21fe</entry>
Aug 17 20:05:49 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:05:49 user nova-compute[72815]:     </system>
Aug 17 20:05:49 user nova-compute[72815]:   </sysinfo>
Aug 17 20:05:49 user nova-compute[72815]:   <os>
Aug 17 20:05:49 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:05:49 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:05:49 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:05:49 user nova-compute[72815]:   </os>
Aug 17 20:05:49 user nova-compute[72815]:   <features>
Aug 17 20:05:49 user nova-compute[72815]:     <acpi/>
Aug 17 20:05:49 user nova-compute[72815]:     <apic/>
Aug 17 20:05:49 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:05:49 user nova-compute[72815]:   </features>
Aug 17 20:05:49 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:05:49 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:05:49 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:05:49 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:05:49 user nova-compute[72815]:   </clock>
Aug 17 20:05:49 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:05:49 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:05:49 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:05:49 user nova-compute[72815]:   </cpu>
Aug 17 20:05:49 user nova-compute[72815]:   <devices>
Aug 17 20:05:49 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:05:49 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:05:49 user nova-compute[72815]:       <source dev="/dev/sdf"/>
Aug 17 20:05:49 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:05:49 user nova-compute[72815]:       <serial>b8af8963-9af0-4e7e-be96-cb1b5313fb25</serial>
Aug 17 20:05:49 user nova-compute[72815]:     </disk>
Aug 17 20:05:49 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:05:49 user nova-compute[72815]:       <mac address="fa:16:3e:04:f9:75"/>
Aug 17 20:05:49 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:05:49 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:05:49 user nova-compute[72815]:       <target dev="tap53829955-ed"/>
Aug 17 20:05:49 user nova-compute[72815]:     </interface>
Aug 17 20:05:49 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:05:49 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/1702dc0c-9333-4f16-937e-31beb1ea21fe/console.log" append="off"/>
Aug 17 20:05:49 user nova-compute[72815]:     </serial>
Aug 17 20:05:49 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:05:49 user nova-compute[72815]:     <video>
Aug 17 20:05:49 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:05:49 user nova-compute[72815]:     </video>
Aug 17 20:05:49 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:05:49 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:05:49 user nova-compute[72815]:     </rng>
Aug 17 20:05:49 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:05:49 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:05:49 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:05:49 user nova-compute[72815]:     </memballoon>
Aug 17 20:05:49 user nova-compute[72815]:   </devices>
Aug 17 20:05:49 user nova-compute[72815]: </domain>
Aug 17 20:05:49 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1062185546',display_name='tempest-TestVolumeBootPattern-server-1062185546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1062185546',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-yaix7ok0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:05:27Z,user_data=None,user_id='577ed0692a254a2fbd518e258563447f',uuid=1702dc0c-9333-4f16-937e-31beb1ea21fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53829955-ed05-4986-b1e9-9bad4ac89908", "address": "fa:16:3e:04:f9:75", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53829955-ed", "ovs_interfaceid": "53829955-ed05-4986-b1e9-9bad4ac89908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "53829955-ed05-4986-b1e9-9bad4ac89908", "address": "fa:16:3e:04:f9:75", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53829955-ed", "ovs_interfaceid": "53829955-ed05-4986-b1e9-9bad4ac89908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f9:75,bridge_name='br-int',has_traffic_filtering=True,id=53829955-ed05-4986-b1e9-9bad4ac89908,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53829955-ed') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG os_vif [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f9:75,bridge_name='br-int',has_traffic_filtering=True,id=53829955-ed05-4986-b1e9-9bad4ac89908,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53829955-ed') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53829955-ed, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53829955-ed, col_values=(('external_ids', {'iface-id': '53829955-ed05-4986-b1e9-9bad4ac89908', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:f9:75', 'vm-uuid': '1702dc0c-9333-4f16-937e-31beb1ea21fe'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:49 user nova-compute[72815]: INFO os_vif [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f9:75,bridge_name='br-int',has_traffic_filtering=True,id=53829955-ed05-4986-b1e9-9bad4ac89908,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53829955-ed')
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Updating instance_info_cache with network_info: [{"id": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "address": "fa:16:3e:82:f3:fc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6629ee00-d5", "ovs_interfaceid": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Releasing lock "refresh_cache-634e7522-f51c-4556-827f-18ec5fee230a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Instance network_info: |[{"id": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "address": "fa:16:3e:82:f3:fc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6629ee00-d5", "ovs_interfaceid": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-05b3d275-cae5-4381-9d50-a48dd9e346fe req-cc029c2f-b237-4636-a1d8-3ab9211fb45f service nova] Acquired lock "refresh_cache-634e7522-f51c-4556-827f-18ec5fee230a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.neutron [req-05b3d275-cae5-4381-9d50-a48dd9e346fe req-cc029c2f-b237-4636-a1d8-3ab9211fb45f service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Refreshing network info cache for port 6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Start _get_guest_xml network_info=[{"id": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "address": "fa:16:3e:82:f3:fc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6629ee00-d5", "ovs_interfaceid": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:05:49 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:05:49 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1454126474',display_name='tempest-AttachVolumeNegativeTest-server-1454126474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1454126474',id=30,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiizNFVflfOsNb1xLlY8D6pbqz9zUc3IoLR5az0gWMgn4ARFnyVMel8um8b99aBN9MpGzfFwAqakb8ty/Z470ZEMP68LsQjQXcpCq+sm2XH5DB4bcNxp+gfHE8eLtJipA==',key_name='tempest-keypair-184602591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ee9b4cae7404f3184fc480ffddfbbcd',ramdisk_id='',reservation_id='r-xwcnfexg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1950293532',owner_user_name='tempest-AttachVolumeNegativeTest-1950293532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:05:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a75e05392d54cfb9fcda786e3ee2efc',uuid=634e7522-f51c-4556-827f-18ec5fee230a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "address": "fa:16:3e:82:f3:fc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6629ee00-d5", "ovs_interfaceid": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converting VIF {"id": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "address": "fa:16:3e:82:f3:fc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6629ee00-d5", "ovs_interfaceid": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:f3:fc,bridge_name='br-int',has_traffic_filtering=True,id=6629ee00-d584-48cd-8e48-3567e19b2f5e,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6629ee00-d5') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'pci_devices' on Instance uuid 634e7522-f51c-4556-827f-18ec5fee230a {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:05:49 user nova-compute[72815]:   <uuid>634e7522-f51c-4556-827f-18ec5fee230a</uuid>
Aug 17 20:05:49 user nova-compute[72815]:   <name>instance-0000001e</name>
Aug 17 20:05:49 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:05:49 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:05:49 user nova-compute[72815]:   <metadata>
Aug 17 20:05:49 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:05:49 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:05:49 user nova-compute[72815]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1454126474</nova:name>
Aug 17 20:05:49 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:05:49</nova:creationTime>
Aug 17 20:05:49 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:05:49 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:05:49 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:05:49 user nova-compute[72815]:       <nova:owner>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:user uuid="2a75e05392d54cfb9fcda786e3ee2efc">tempest-AttachVolumeNegativeTest-1950293532-project-member</nova:user>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:project uuid="9ee9b4cae7404f3184fc480ffddfbbcd">tempest-AttachVolumeNegativeTest-1950293532</nova:project>
Aug 17 20:05:49 user nova-compute[72815]:       </nova:owner>
Aug 17 20:05:49 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:05:49 user nova-compute[72815]:       <nova:ports>
Aug 17 20:05:49 user nova-compute[72815]:         <nova:port uuid="6629ee00-d584-48cd-8e48-3567e19b2f5e">
Aug 17 20:05:49 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 20:05:49 user nova-compute[72815]:         </nova:port>
Aug 17 20:05:49 user nova-compute[72815]:       </nova:ports>
Aug 17 20:05:49 user nova-compute[72815]:     </nova:instance>
Aug 17 20:05:49 user nova-compute[72815]:   </metadata>
Aug 17 20:05:49 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:05:49 user nova-compute[72815]:     <system>
Aug 17 20:05:49 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:05:49 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:05:49 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:05:49 user nova-compute[72815]:       <entry name="serial">634e7522-f51c-4556-827f-18ec5fee230a</entry>
Aug 17 20:05:49 user nova-compute[72815]:       <entry name="uuid">634e7522-f51c-4556-827f-18ec5fee230a</entry>
Aug 17 20:05:49 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:05:49 user nova-compute[72815]:     </system>
Aug 17 20:05:49 user nova-compute[72815]:   </sysinfo>
Aug 17 20:05:49 user nova-compute[72815]:   <os>
Aug 17 20:05:49 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:05:49 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:05:49 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:05:49 user nova-compute[72815]:   </os>
Aug 17 20:05:49 user nova-compute[72815]:   <features>
Aug 17 20:05:49 user nova-compute[72815]:     <acpi/>
Aug 17 20:05:49 user nova-compute[72815]:     <apic/>
Aug 17 20:05:49 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:05:49 user nova-compute[72815]:   </features>
Aug 17 20:05:49 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:05:49 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:05:49 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:05:49 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:05:49 user nova-compute[72815]:   </clock>
Aug 17 20:05:49 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:05:49 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:05:49 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:05:49 user nova-compute[72815]:   </cpu>
Aug 17 20:05:49 user nova-compute[72815]:   <devices>
Aug 17 20:05:49 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:05:49 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:05:49 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk"/>
Aug 17 20:05:49 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:05:49 user nova-compute[72815]:     </disk>
Aug 17 20:05:49 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:05:49 user nova-compute[72815]:       <mac address="fa:16:3e:82:f3:fc"/>
Aug 17 20:05:49 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:05:49 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:05:49 user nova-compute[72815]:       <target dev="tap6629ee00-d5"/>
Aug 17 20:05:49 user nova-compute[72815]:     </interface>
Aug 17 20:05:49 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:05:49 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/console.log" append="off"/>
Aug 17 20:05:49 user nova-compute[72815]:     </serial>
Aug 17 20:05:49 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:05:49 user nova-compute[72815]:     <video>
Aug 17 20:05:49 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:05:49 user nova-compute[72815]:     </video>
Aug 17 20:05:49 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:05:49 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:05:49 user nova-compute[72815]:     </rng>
Aug 17 20:05:49 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:05:49 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:05:49 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:05:49 user nova-compute[72815]:     </memballoon>
Aug 17 20:05:49 user nova-compute[72815]:   </devices>
Aug 17 20:05:49 user nova-compute[72815]: </domain>
Aug 17 20:05:49 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1454126474',display_name='tempest-AttachVolumeNegativeTest-server-1454126474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1454126474',id=30,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiizNFVflfOsNb1xLlY8D6pbqz9zUc3IoLR5az0gWMgn4ARFnyVMel8um8b99aBN9MpGzfFwAqakb8ty/Z470ZEMP68LsQjQXcpCq+sm2XH5DB4bcNxp+gfHE8eLtJipA==',key_name='tempest-keypair-184602591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ee9b4cae7404f3184fc480ffddfbbcd',ramdisk_id='',reservation_id='r-xwcnfexg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1950293532',owner_user_name='tempest-AttachVolumeNegativeTest-1950293532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:05:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a75e05392d54cfb9fcda786e3ee2efc',uuid=634e7522-f51c-4556-827f-18ec5fee230a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "address": "fa:16:3e:82:f3:fc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6629ee00-d5", "ovs_interfaceid": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converting VIF {"id": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "address": "fa:16:3e:82:f3:fc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6629ee00-d5", "ovs_interfaceid": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:f3:fc,bridge_name='br-int',has_traffic_filtering=True,id=6629ee00-d584-48cd-8e48-3567e19b2f5e,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6629ee00-d5') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG os_vif [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f3:fc,bridge_name='br-int',has_traffic_filtering=True,id=6629ee00-d584-48cd-8e48-3567e19b2f5e,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6629ee00-d5') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6629ee00-d5, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6629ee00-d5, col_values=(('external_ids', {'iface-id': '6629ee00-d584-48cd-8e48-3567e19b2f5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:f3:fc', 'vm-uuid': '634e7522-f51c-4556-827f-18ec5fee230a'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] No VIF found with MAC fa:16:3e:04:f9:75, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:49 user nova-compute[72815]: INFO os_vif [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f3:fc,bridge_name='br-int',has_traffic_filtering=True,id=6629ee00-d584-48cd-8e48-3567e19b2f5e,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6629ee00-d5')
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:05:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No VIF found with MAC fa:16:3e:82:f3:fc, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:05:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-05b3d275-cae5-4381-9d50-a48dd9e346fe req-cc029c2f-b237-4636-a1d8-3ab9211fb45f service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Updated VIF entry in instance network info cache for port 6629ee00-d584-48cd-8e48-3567e19b2f5e. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:05:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-05b3d275-cae5-4381-9d50-a48dd9e346fe req-cc029c2f-b237-4636-a1d8-3ab9211fb45f service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Updating instance_info_cache with network_info: [{"id": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "address": "fa:16:3e:82:f3:fc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6629ee00-d5", "ovs_interfaceid": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-05b3d275-cae5-4381-9d50-a48dd9e346fe req-cc029c2f-b237-4636-a1d8-3ab9211fb45f service nova] Releasing lock "refresh_cache-634e7522-f51c-4556-827f-18ec5fee230a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:05:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-f3aa22e9-59f8-4d6f-afd8-080981f0f70c req-fe096394-19b0-4bc7-a163-b8e221c87c42 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received event network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f3aa22e9-59f8-4d6f-afd8-080981f0f70c req-fe096394-19b0-4bc7-a163-b8e221c87c42 service nova] Acquiring lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f3aa22e9-59f8-4d6f-afd8-080981f0f70c req-fe096394-19b0-4bc7-a163-b8e221c87c42 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f3aa22e9-59f8-4d6f-afd8-080981f0f70c req-fe096394-19b0-4bc7-a163-b8e221c87c42 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-f3aa22e9-59f8-4d6f-afd8-080981f0f70c req-fe096394-19b0-4bc7-a163-b8e221c87c42 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] No waiting events found dispatching network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:52 user nova-compute[72815]: WARNING nova.compute.manager [req-f3aa22e9-59f8-4d6f-afd8-080981f0f70c req-fe096394-19b0-4bc7-a163-b8e221c87c42 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received unexpected event network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 for instance with vm_state building and task_state spawning.
Aug 17 20:05:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-bdcf6e02-f2fc-40ce-bc48-8abf6d082a1d req-d0c85af0-df54-48ca-b44c-6e06726a33fc service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Received event network-vif-plugged-6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bdcf6e02-f2fc-40ce-bc48-8abf6d082a1d req-d0c85af0-df54-48ca-b44c-6e06726a33fc service nova] Acquiring lock "634e7522-f51c-4556-827f-18ec5fee230a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bdcf6e02-f2fc-40ce-bc48-8abf6d082a1d req-d0c85af0-df54-48ca-b44c-6e06726a33fc service nova] Lock "634e7522-f51c-4556-827f-18ec5fee230a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bdcf6e02-f2fc-40ce-bc48-8abf6d082a1d req-d0c85af0-df54-48ca-b44c-6e06726a33fc service nova] Lock "634e7522-f51c-4556-827f-18ec5fee230a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-bdcf6e02-f2fc-40ce-bc48-8abf6d082a1d req-d0c85af0-df54-48ca-b44c-6e06726a33fc service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] No waiting events found dispatching network-vif-plugged-6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:52 user nova-compute[72815]: WARNING nova.compute.manager [req-bdcf6e02-f2fc-40ce-bc48-8abf6d082a1d req-d0c85af0-df54-48ca-b44c-6e06726a33fc service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Received unexpected event network-vif-plugged-6629ee00-d584-48cd-8e48-3567e19b2f5e for instance with vm_state building and task_state spawning.
Aug 17 20:05:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:53 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302738.8477194, 3a4f27f3-4573-43b5-827a-bbdae4ebce10 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:05:53 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] VM Stopped (Lifecycle Event)
Aug 17 20:05:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-3d327e31-d76a-40ac-a929-69c37d29e236 None None] [instance: 3a4f27f3-4573-43b5-827a-bbdae4ebce10] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-1ffc0d43-1a94-42fc-a034-e337135df10a req-9aebd9ce-6466-4e2a-bff3-c38cccaf0f1f service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received event network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ffc0d43-1a94-42fc-a034-e337135df10a req-9aebd9ce-6466-4e2a-bff3-c38cccaf0f1f service nova] Acquiring lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ffc0d43-1a94-42fc-a034-e337135df10a req-9aebd9ce-6466-4e2a-bff3-c38cccaf0f1f service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ffc0d43-1a94-42fc-a034-e337135df10a req-9aebd9ce-6466-4e2a-bff3-c38cccaf0f1f service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-1ffc0d43-1a94-42fc-a034-e337135df10a req-9aebd9ce-6466-4e2a-bff3-c38cccaf0f1f service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] No waiting events found dispatching network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:54 user nova-compute[72815]: WARNING nova.compute.manager [req-1ffc0d43-1a94-42fc-a034-e337135df10a req-9aebd9ce-6466-4e2a-bff3-c38cccaf0f1f service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received unexpected event network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 for instance with vm_state building and task_state spawning.
Aug 17 20:05:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-8a1ce97c-41c2-4483-8cf3-e8b4eb00984e req-48a6f903-6c04-4fa1-8aaf-162dcdf34776 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Received event network-vif-plugged-6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8a1ce97c-41c2-4483-8cf3-e8b4eb00984e req-48a6f903-6c04-4fa1-8aaf-162dcdf34776 service nova] Acquiring lock "634e7522-f51c-4556-827f-18ec5fee230a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8a1ce97c-41c2-4483-8cf3-e8b4eb00984e req-48a6f903-6c04-4fa1-8aaf-162dcdf34776 service nova] Lock "634e7522-f51c-4556-827f-18ec5fee230a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8a1ce97c-41c2-4483-8cf3-e8b4eb00984e req-48a6f903-6c04-4fa1-8aaf-162dcdf34776 service nova] Lock "634e7522-f51c-4556-827f-18ec5fee230a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-8a1ce97c-41c2-4483-8cf3-e8b4eb00984e req-48a6f903-6c04-4fa1-8aaf-162dcdf34776 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] No waiting events found dispatching network-vif-plugged-6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:54 user nova-compute[72815]: WARNING nova.compute.manager [req-8a1ce97c-41c2-4483-8cf3-e8b4eb00984e req-48a6f903-6c04-4fa1-8aaf-162dcdf34776 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Received unexpected event network-vif-plugged-6629ee00-d584-48cd-8e48-3567e19b2f5e for instance with vm_state building and task_state spawning.
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302754.945042, 634e7522-f51c-4556-827f-18ec5fee230a => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:05:54 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] VM Resumed (Lifecycle Event)
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:05:54 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Instance spawned successfully.
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:05:54 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Instance spawned successfully.
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:05:55 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:05:55 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302754.947389, 1702dc0c-9333-4f16-937e-31beb1ea21fe => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:05:55 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] VM Resumed (Lifecycle Event)
Aug 17 20:05:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:05:55 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:05:55 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302754.9527144, 634e7522-f51c-4556-827f-18ec5fee230a => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:05:55 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] VM Started (Lifecycle Event)
Aug 17 20:05:55 user nova-compute[72815]: INFO nova.compute.manager [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Took 8.21 seconds to spawn the instance on the hypervisor.
Aug 17 20:05:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:55 user nova-compute[72815]: INFO nova.compute.manager [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Took 8.02 seconds to spawn the instance on the hypervisor.
Aug 17 20:05:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:05:55 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:05:55 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302754.9528198, 1702dc0c-9333-4f16-937e-31beb1ea21fe => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:05:55 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] VM Started (Lifecycle Event)
Aug 17 20:05:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:05:55 user nova-compute[72815]: INFO nova.compute.manager [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Took 9.11 seconds to build instance.
Aug 17 20:05:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:05:55 user nova-compute[72815]: INFO nova.compute.manager [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Took 29.34 seconds to build instance.
Aug 17 20:05:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7b67a014-bc8a-4b54-8434-2593875fd1c1 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "634e7522-f51c-4556-827f-18ec5fee230a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.226s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-fbc50dce-14b7-411f-b5a4-6b5d6864dadb tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.431s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:56 user nova-compute[72815]: INFO nova.compute.manager [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Terminating instance
Aug 17 20:05:56 user nova-compute[72815]: DEBUG nova.compute.manager [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-97a59960-859c-404a-aa78-a97ee23f9267 req-5e666bda-4b34-4866-b6b7-9dbe706f5911 service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Received event network-vif-unplugged-75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-97a59960-859c-404a-aa78-a97ee23f9267 req-5e666bda-4b34-4866-b6b7-9dbe706f5911 service nova] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-97a59960-859c-404a-aa78-a97ee23f9267 req-5e666bda-4b34-4866-b6b7-9dbe706f5911 service nova] Lock "71e8c292-6412-4079-8a2c-11c65c808588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-97a59960-859c-404a-aa78-a97ee23f9267 req-5e666bda-4b34-4866-b6b7-9dbe706f5911 service nova] Lock "71e8c292-6412-4079-8a2c-11c65c808588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-97a59960-859c-404a-aa78-a97ee23f9267 req-5e666bda-4b34-4866-b6b7-9dbe706f5911 service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] No waiting events found dispatching network-vif-unplugged-75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-97a59960-859c-404a-aa78-a97ee23f9267 req-5e666bda-4b34-4866-b6b7-9dbe706f5911 service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Received event network-vif-unplugged-75f40a91-a6d6-45b0-8146-b63ed8690498 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:56 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Instance destroyed successfully.
Aug 17 20:05:56 user nova-compute[72815]: DEBUG nova.objects.instance [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lazy-loading 'resources' on Instance uuid 71e8c292-6412-4079-8a2c-11c65c808588 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-242370575',display_name='tempest-TestServerVolumeAttachmentScenario-server-242370575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-242370575',id=22,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoBVbMx2raNF0AqTw51Fef49/Xz5GWR9t9CcFBY08XKOcj8ZDyO/Wx9IoVtAaX1Jy+7AcPGu0djvA1/aRjBgKx/7fnM4seRPfHjIV5g3/FlJa2MoC8olXEWTIFbIr7C5w==',key_name='tempest-keypair-1710876700',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0520c959f1a5480293b0c8f501da0dd3',ramdisk_id='',reservation_id='r-63ro1bh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-599186245',owner_user_name='tempest-TestServerVolumeAttachmentScenario-599186245-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='783d6f5af68c4efe83fb8574f129882d',uuid=71e8c292-6412-4079-8a2c-11c65c808588,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75f40a91-a6d6-45b0-8146-b63ed8690498", "address": "fa:16:3e:9d:8b:8a", "network": {"id": "4d7c633c-edae-419d-823d-f83bfc69b641", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1851083827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520c959f1a5480293b0c8f501da0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f40a91-a6", "ovs_interfaceid": "75f40a91-a6d6-45b0-8146-b63ed8690498", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Converting VIF {"id": "75f40a91-a6d6-45b0-8146-b63ed8690498", "address": "fa:16:3e:9d:8b:8a", "network": {"id": "4d7c633c-edae-419d-823d-f83bfc69b641", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1851083827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520c959f1a5480293b0c8f501da0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f40a91-a6", "ovs_interfaceid": "75f40a91-a6d6-45b0-8146-b63ed8690498", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=75f40a91-a6d6-45b0-8146-b63ed8690498,network=Network(4d7c633c-edae-419d-823d-f83bfc69b641),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f40a91-a6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG os_vif [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=75f40a91-a6d6-45b0-8146-b63ed8690498,network=Network(4d7c633c-edae-419d-823d-f83bfc69b641),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f40a91-a6') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75f40a91-a6, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:05:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:05:56 user nova-compute[72815]: INFO os_vif [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=75f40a91-a6d6-45b0-8146-b63ed8690498,network=Network(4d7c633c-edae-419d-823d-f83bfc69b641),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f40a91-a6')
Aug 17 20:05:57 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Deleting instance files /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588_del
Aug 17 20:05:57 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Deletion of /opt/stack/data/nova/instances/71e8c292-6412-4079-8a2c-11c65c808588_del complete
Aug 17 20:05:57 user nova-compute[72815]: INFO nova.compute.manager [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 20:05:57 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:05:57 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:05:57 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:05:58 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:05:58 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Took 0.98 seconds to deallocate network for instance.
Aug 17 20:05:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-839e5817-c6f8-4331-9f7f-98fc02877e76 req-e5d58ca9-33ce-4d97-820e-77c828feb351 service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Received event network-vif-deleted-75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-41ec0457-f933-4f4a-82fe-44f541a3534d req-749e5dae-d8ab-4981-aa37-7ac90e0bd43a service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Received event network-vif-plugged-75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:05:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-41ec0457-f933-4f4a-82fe-44f541a3534d req-749e5dae-d8ab-4981-aa37-7ac90e0bd43a service nova] Acquiring lock "71e8c292-6412-4079-8a2c-11c65c808588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:05:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-41ec0457-f933-4f4a-82fe-44f541a3534d req-749e5dae-d8ab-4981-aa37-7ac90e0bd43a service nova] Lock "71e8c292-6412-4079-8a2c-11c65c808588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:05:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-41ec0457-f933-4f4a-82fe-44f541a3534d req-749e5dae-d8ab-4981-aa37-7ac90e0bd43a service nova] Lock "71e8c292-6412-4079-8a2c-11c65c808588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-41ec0457-f933-4f4a-82fe-44f541a3534d req-749e5dae-d8ab-4981-aa37-7ac90e0bd43a service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] No waiting events found dispatching network-vif-plugged-75f40a91-a6d6-45b0-8146-b63ed8690498 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:05:58 user nova-compute[72815]: WARNING nova.compute.manager [req-41ec0457-f933-4f4a-82fe-44f541a3534d req-749e5dae-d8ab-4981-aa37-7ac90e0bd43a service nova] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Received unexpected event network-vif-plugged-75f40a91-a6d6-45b0-8146-b63ed8690498 for instance with vm_state deleted and task_state None.
Aug 17 20:05:58 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:05:58 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:05:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:05:58 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Deleted allocations for instance 71e8c292-6412-4079-8a2c-11c65c808588
Aug 17 20:05:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-47cfe84d-2c71-4c6c-a3b4-d633cbc61af8 tempest-TestServerVolumeAttachmentScenario-599186245 tempest-TestServerVolumeAttachmentScenario-599186245-project-member] Lock "71e8c292-6412-4079-8a2c-11c65c808588" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.654s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:02 user nova-compute[72815]: INFO nova.compute.manager [None req-25aea4e6-0bef-4eaf-bb70-c21caf5520fa tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Unrescuing
Aug 17 20:06:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-25aea4e6-0bef-4eaf-bb70-c21caf5520fa tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:06:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-25aea4e6-0bef-4eaf-bb70-c21caf5520fa tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquired lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:06:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-25aea4e6-0bef-4eaf-bb70-c21caf5520fa tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:06:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-25aea4e6-0bef-4eaf-bb70-c21caf5520fa tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Updating instance_info_cache with network_info: [{"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:06:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-25aea4e6-0bef-4eaf-bb70-c21caf5520fa tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Releasing lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:06:02 user nova-compute[72815]: DEBUG nova.objects.instance [None req-25aea4e6-0bef-4eaf-bb70-c21caf5520fa tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'flavor' on Instance uuid dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-1aca8e1d-8d80-42b9-ae55-cf83ccf7650e req-ee0afe8f-62a8-4d0c-bc1a-b3528d339ef3 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-unplugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1aca8e1d-8d80-42b9-ae55-cf83ccf7650e req-ee0afe8f-62a8-4d0c-bc1a-b3528d339ef3 service nova] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1aca8e1d-8d80-42b9-ae55-cf83ccf7650e req-ee0afe8f-62a8-4d0c-bc1a-b3528d339ef3 service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1aca8e1d-8d80-42b9-ae55-cf83ccf7650e req-ee0afe8f-62a8-4d0c-bc1a-b3528d339ef3 service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-1aca8e1d-8d80-42b9-ae55-cf83ccf7650e req-ee0afe8f-62a8-4d0c-bc1a-b3528d339ef3 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] No waiting events found dispatching network-vif-unplugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:06:03 user nova-compute[72815]: WARNING nova.compute.manager [req-1aca8e1d-8d80-42b9-ae55-cf83ccf7650e req-ee0afe8f-62a8-4d0c-bc1a-b3528d339ef3 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received unexpected event network-vif-unplugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe for instance with vm_state rescued and task_state unrescuing.
Aug 17 20:06:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:03 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Instance destroyed successfully.
Aug 17 20:06:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:06:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:06:05 user nova-compute[72815]: INFO nova.compute.claims [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Claim successful on node user
Aug 17 20:06:05 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-73547dab-fb8d-44b8-b9a7-2a1c91c15ab6 req-16e28eda-a881-44ad-8ce1-b32f7c8ed7c8 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-73547dab-fb8d-44b8-b9a7-2a1c91c15ab6 req-16e28eda-a881-44ad-8ce1-b32f7c8ed7c8 service nova] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-73547dab-fb8d-44b8-b9a7-2a1c91c15ab6 req-16e28eda-a881-44ad-8ce1-b32f7c8ed7c8 service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-73547dab-fb8d-44b8-b9a7-2a1c91c15ab6 req-16e28eda-a881-44ad-8ce1-b32f7c8ed7c8 service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-73547dab-fb8d-44b8-b9a7-2a1c91c15ab6 req-16e28eda-a881-44ad-8ce1-b32f7c8ed7c8 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] No waiting events found dispatching network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:06:05 user nova-compute[72815]: WARNING nova.compute.manager [req-73547dab-fb8d-44b8-b9a7-2a1c91c15ab6 req-16e28eda-a881-44ad-8ce1-b32f7c8ed7c8 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received unexpected event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe for instance with vm_state rescued and task_state unrescuing.
Aug 17 20:06:05 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:06:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:06:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:06:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Creating image(s)
Aug 17 20:06:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "/opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "/opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:05 user nova-compute[72815]: DEBUG nova.policy [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a82d9b206cf4499eaf518f7cd6a7a10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140294f17e4751b13e2d4a15b17ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.269s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.217s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk 1073741824" returned: 0 in 0.065s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.254s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Cannot resize image /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'migration_context' on Instance uuid 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Ensure instance console log exists: /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302767.0580328, dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:06:07 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] VM Resumed (Lifecycle Event)
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-25aea4e6-0bef-4eaf-bb70-c21caf5520fa tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Successfully created port: defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:06:07 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302767.0623195, dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:06:07 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] VM Started (Lifecycle Event)
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-2fcb5b84-927b-4b7c-8fff-35f3aa663cd9 req-0ac18ffa-32c2-478d-b77a-597ab0ad35da service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2fcb5b84-927b-4b7c-8fff-35f3aa663cd9 req-0ac18ffa-32c2-478d-b77a-597ab0ad35da service nova] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2fcb5b84-927b-4b7c-8fff-35f3aa663cd9 req-0ac18ffa-32c2-478d-b77a-597ab0ad35da service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2fcb5b84-927b-4b7c-8fff-35f3aa663cd9 req-0ac18ffa-32c2-478d-b77a-597ab0ad35da service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-2fcb5b84-927b-4b7c-8fff-35f3aa663cd9 req-0ac18ffa-32c2-478d-b77a-597ab0ad35da service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] No waiting events found dispatching network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:06:07 user nova-compute[72815]: WARNING nova.compute.manager [req-2fcb5b84-927b-4b7c-8fff-35f3aa663cd9 req-0ac18ffa-32c2-478d-b77a-597ab0ad35da service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received unexpected event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe for instance with vm_state active and task_state None.
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-2fcb5b84-927b-4b7c-8fff-35f3aa663cd9 req-0ac18ffa-32c2-478d-b77a-597ab0ad35da service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2fcb5b84-927b-4b7c-8fff-35f3aa663cd9 req-0ac18ffa-32c2-478d-b77a-597ab0ad35da service nova] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2fcb5b84-927b-4b7c-8fff-35f3aa663cd9 req-0ac18ffa-32c2-478d-b77a-597ab0ad35da service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2fcb5b84-927b-4b7c-8fff-35f3aa663cd9 req-0ac18ffa-32c2-478d-b77a-597ab0ad35da service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-2fcb5b84-927b-4b7c-8fff-35f3aa663cd9 req-0ac18ffa-32c2-478d-b77a-597ab0ad35da service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] No waiting events found dispatching network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:06:07 user nova-compute[72815]: WARNING nova.compute.manager [req-2fcb5b84-927b-4b7c-8fff-35f3aa663cd9 req-0ac18ffa-32c2-478d-b77a-597ab0ad35da service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received unexpected event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe for instance with vm_state active and task_state None.
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Successfully updated port: defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquired lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updating instance_info_cache with network_info: [{"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Releasing lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Instance network_info: |[{"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Start _get_guest_xml network_info=[{"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:06:08 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:06:08 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-592611439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-592611439',id=31,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCNKJMEO1Iytsf6/eVE9Y1d1Ku4ylaFFaVwjCGf7SFQEDJ72TegDIOZqXt942HFg78gbDzYNttm/7+HntlcJ5blGKKCBKylGb8Q6G5S2YBjjsIScxsDUCsXsFIGuZTZKQ==',key_name='tempest-keypair-1811635152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa140294f17e4751b13e2d4a15b17ff9',ramdisk_id='',reservation_id='r-08iiaggg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-632866040',owner_user_name='tempest-AttachVolumeShelveTestJSON-632866040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82d9b206cf4499eaf518f7cd6a7a10c',uuid=2ed62592-a25a-46cf-976a-5f2edbe6d5e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converting VIF {"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:06:08 user nova-compute[72815]:   <uuid>2ed62592-a25a-46cf-976a-5f2edbe6d5e0</uuid>
Aug 17 20:06:08 user nova-compute[72815]:   <name>instance-0000001f</name>
Aug 17 20:06:08 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:06:08 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:06:08 user nova-compute[72815]:   <metadata>
Aug 17 20:06:08 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:06:08 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:06:08 user nova-compute[72815]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-592611439</nova:name>
Aug 17 20:06:08 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:06:08</nova:creationTime>
Aug 17 20:06:08 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:06:08 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:06:08 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:06:08 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:06:08 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:06:08 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:06:08 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:06:08 user nova-compute[72815]:       <nova:owner>
Aug 17 20:06:08 user nova-compute[72815]:         <nova:user uuid="a82d9b206cf4499eaf518f7cd6a7a10c">tempest-AttachVolumeShelveTestJSON-632866040-project-member</nova:user>
Aug 17 20:06:08 user nova-compute[72815]:         <nova:project uuid="aa140294f17e4751b13e2d4a15b17ff9">tempest-AttachVolumeShelveTestJSON-632866040</nova:project>
Aug 17 20:06:08 user nova-compute[72815]:       </nova:owner>
Aug 17 20:06:08 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:06:08 user nova-compute[72815]:       <nova:ports>
Aug 17 20:06:08 user nova-compute[72815]:         <nova:port uuid="defc548f-4a74-4cdf-b1a8-12236dcf71e9">
Aug 17 20:06:08 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 20:06:08 user nova-compute[72815]:         </nova:port>
Aug 17 20:06:08 user nova-compute[72815]:       </nova:ports>
Aug 17 20:06:08 user nova-compute[72815]:     </nova:instance>
Aug 17 20:06:08 user nova-compute[72815]:   </metadata>
Aug 17 20:06:08 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:06:08 user nova-compute[72815]:     <system>
Aug 17 20:06:08 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:06:08 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:06:08 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:06:08 user nova-compute[72815]:       <entry name="serial">2ed62592-a25a-46cf-976a-5f2edbe6d5e0</entry>
Aug 17 20:06:08 user nova-compute[72815]:       <entry name="uuid">2ed62592-a25a-46cf-976a-5f2edbe6d5e0</entry>
Aug 17 20:06:08 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:06:08 user nova-compute[72815]:     </system>
Aug 17 20:06:08 user nova-compute[72815]:   </sysinfo>
Aug 17 20:06:08 user nova-compute[72815]:   <os>
Aug 17 20:06:08 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:06:08 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:06:08 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:06:08 user nova-compute[72815]:   </os>
Aug 17 20:06:08 user nova-compute[72815]:   <features>
Aug 17 20:06:08 user nova-compute[72815]:     <acpi/>
Aug 17 20:06:08 user nova-compute[72815]:     <apic/>
Aug 17 20:06:08 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:06:08 user nova-compute[72815]:   </features>
Aug 17 20:06:08 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:06:08 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:06:08 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:06:08 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:06:08 user nova-compute[72815]:   </clock>
Aug 17 20:06:08 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:06:08 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:06:08 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:06:08 user nova-compute[72815]:   </cpu>
Aug 17 20:06:08 user nova-compute[72815]:   <devices>
Aug 17 20:06:08 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:06:08 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:06:08 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk"/>
Aug 17 20:06:08 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:06:08 user nova-compute[72815]:     </disk>
Aug 17 20:06:08 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:06:08 user nova-compute[72815]:       <mac address="fa:16:3e:76:67:47"/>
Aug 17 20:06:08 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:06:08 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:06:08 user nova-compute[72815]:       <target dev="tapdefc548f-4a"/>
Aug 17 20:06:08 user nova-compute[72815]:     </interface>
Aug 17 20:06:08 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:06:08 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/console.log" append="off"/>
Aug 17 20:06:08 user nova-compute[72815]:     </serial>
Aug 17 20:06:08 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:06:08 user nova-compute[72815]:     <video>
Aug 17 20:06:08 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:06:08 user nova-compute[72815]:     </video>
Aug 17 20:06:08 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:06:08 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:06:08 user nova-compute[72815]:     </rng>
Aug 17 20:06:08 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:06:08 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:06:08 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:06:08 user nova-compute[72815]:     </memballoon>
Aug 17 20:06:08 user nova-compute[72815]:   </devices>
Aug 17 20:06:08 user nova-compute[72815]: </domain>
Aug 17 20:06:08 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-592611439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-592611439',id=31,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCNKJMEO1Iytsf6/eVE9Y1d1Ku4ylaFFaVwjCGf7SFQEDJ72TegDIOZqXt942HFg78gbDzYNttm/7+HntlcJ5blGKKCBKylGb8Q6G5S2YBjjsIScxsDUCsXsFIGuZTZKQ==',key_name='tempest-keypair-1811635152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa140294f17e4751b13e2d4a15b17ff9',ramdisk_id='',reservation_id='r-08iiaggg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-632866040',owner_user_name='tempest-AttachVolumeShelveTestJSON-632866040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82d9b206cf4499eaf518f7cd6a7a10c',uuid=2ed62592-a25a-46cf-976a-5f2edbe6d5e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converting VIF {"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG os_vif [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdefc548f-4a, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdefc548f-4a, col_values=(('external_ids', {'iface-id': 'defc548f-4a74-4cdf-b1a8-12236dcf71e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:67:47', 'vm-uuid': '2ed62592-a25a-46cf-976a-5f2edbe6d5e0'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:08 user nova-compute[72815]: INFO os_vif [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a')
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:06:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] No VIF found with MAC fa:16:3e:76:67:47, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:06:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-dbb8d7ab-f9c1-491f-a469-82e5de01dda6 req-d07a1ad2-083c-4221-b1e1-c929acf4574e service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-changed-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-dbb8d7ab-f9c1-491f-a469-82e5de01dda6 req-d07a1ad2-083c-4221-b1e1-c929acf4574e service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Refreshing instance network info cache due to event network-changed-defc548f-4a74-4cdf-b1a8-12236dcf71e9. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:06:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dbb8d7ab-f9c1-491f-a469-82e5de01dda6 req-d07a1ad2-083c-4221-b1e1-c929acf4574e service nova] Acquiring lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:06:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dbb8d7ab-f9c1-491f-a469-82e5de01dda6 req-d07a1ad2-083c-4221-b1e1-c929acf4574e service nova] Acquired lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:06:09 user nova-compute[72815]: DEBUG nova.network.neutron [req-dbb8d7ab-f9c1-491f-a469-82e5de01dda6 req-d07a1ad2-083c-4221-b1e1-c929acf4574e service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Refreshing network info cache for port defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:06:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-dbb8d7ab-f9c1-491f-a469-82e5de01dda6 req-d07a1ad2-083c-4221-b1e1-c929acf4574e service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updated VIF entry in instance network info cache for port defc548f-4a74-4cdf-b1a8-12236dcf71e9. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:06:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-dbb8d7ab-f9c1-491f-a469-82e5de01dda6 req-d07a1ad2-083c-4221-b1e1-c929acf4574e service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updating instance_info_cache with network_info: [{"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:06:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dbb8d7ab-f9c1-491f-a469-82e5de01dda6 req-d07a1ad2-083c-4221-b1e1-c929acf4574e service nova] Releasing lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:06:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-17f3b063-21c5-4519-bdc4-6b8d03928d85 req-0ed5fa1b-fa9f-433f-9081-f68311f5f276 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-17f3b063-21c5-4519-bdc4-6b8d03928d85 req-0ed5fa1b-fa9f-433f-9081-f68311f5f276 service nova] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-17f3b063-21c5-4519-bdc4-6b8d03928d85 req-0ed5fa1b-fa9f-433f-9081-f68311f5f276 service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-17f3b063-21c5-4519-bdc4-6b8d03928d85 req-0ed5fa1b-fa9f-433f-9081-f68311f5f276 service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-17f3b063-21c5-4519-bdc4-6b8d03928d85 req-0ed5fa1b-fa9f-433f-9081-f68311f5f276 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] No waiting events found dispatching network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:06:10 user nova-compute[72815]: WARNING nova.compute.manager [req-17f3b063-21c5-4519-bdc4-6b8d03928d85 req-0ed5fa1b-fa9f-433f-9081-f68311f5f276 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received unexpected event network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 for instance with vm_state building and task_state spawning.
Aug 17 20:06:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:11 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302756.9541776, 71e8c292-6412-4079-8a2c-11c65c808588 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:06:11 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] VM Stopped (Lifecycle Event)
Aug 17 20:06:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-3f2ec91c-0470-458e-ba09-274881bec809 None None] [instance: 71e8c292-6412-4079-8a2c-11c65c808588] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302772.656688, 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:06:12 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] VM Resumed (Lifecycle Event)
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:06:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Instance spawned successfully.
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:06:12 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302772.658092, 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:06:12 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] VM Started (Lifecycle Event)
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] No waiting events found dispatching network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:06:12 user nova-compute[72815]: WARNING nova.compute.manager [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received unexpected event network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 for instance with vm_state building and task_state spawning.
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-changed-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Refreshing instance network info cache due to event network-changed-97b110e2-ceca-4ed9-8886-8d7d2149339f. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] Acquiring lock "refresh_cache-fa0a87a2-9816-4aed-901d-1dff953f8046" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] Acquired lock "refresh_cache-fa0a87a2-9816-4aed-901d-1dff953f8046" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.network.neutron [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Refreshing network info cache for port 97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:06:12 user nova-compute[72815]: INFO nova.compute.manager [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Took 6.95 seconds to spawn the instance on the hypervisor.
Aug 17 20:06:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:06:12 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:06:12 user nova-compute[72815]: INFO nova.compute.manager [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Took 7.93 seconds to build instance.
Aug 17 20:06:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0be40037-5c08-4033-b7d9-d2a1fbd098f6 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.104s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Updated VIF entry in instance network info cache for port 97b110e2-ceca-4ed9-8886-8d7d2149339f. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:06:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Updating instance_info_cache with network_info: [{"id": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "address": "fa:16:3e:23:f4:e4", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b110e2-ce", "ovs_interfaceid": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:06:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cb50d9f3-9fc6-4aeb-be5c-adafc2a834ba req-5dd68f52-28de-4142-9258-c91d33091036 service nova] Releasing lock "refresh_cache-fa0a87a2-9816-4aed-901d-1dff953f8046" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:06:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG nova.objects.instance [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid fa0a87a2-9816-4aed-901d-1dff953f8046 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:17 user nova-compute[72815]: INFO nova.compute.manager [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Attaching volume a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 to /dev/vdb
Aug 17 20:06:17 user nova-compute[72815]: DEBUG os_brick.utils [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38db245-57ea-438b-ba62-dfaf7f74065b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d934085-5001-4f1b-ad4e-ff6c6d34e09e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f362fdff-b156-4619-aae0-6fbb061a0198]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[581467f5-ab78-4698-a602-47feac5e4b30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:06:17 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:06:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[99615a59-4be5-48fa-ac87-4fcb8e561a9a]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:06:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:06:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:06:18 user nova-compute[72815]: DEBUG os_brick.utils [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:06:18 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Updating existing volume attachment record: dccf6e5f-90e2-4618-a477-74be61c94fb0 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:06:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:30 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:06:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:30 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:06:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:06:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:35 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:06:35 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:06:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=6747MB free_disk=25.345829010009766GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:06:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 12a34846-1670-4c6c-ac7d-522530aaf3a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 72c9428f-f797-46b4-9780-d2a4abb01ae7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance fa0a87a2-9816-4aed-901d-1dff953f8046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance caffa446-5b29-4c5d-b756-4cc7119676cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 4c630764-4e1b-4bab-b354-1389cd60f5a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1702dc0c-9333-4f16-937e-31beb1ea21fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 634e7522-f51c-4556-827f-18ec5fee230a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xezWdmJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:06:37 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:06:37 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:06:37 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b70375-7d80-416a-abd7-60a8d441f203]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:06:37 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f74f36-5523-40b0-b65f-d339b73aae80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9] added
Aug 17 20:06:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c35fa3-764b-4578-accf-c46355d65f49]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c6992-5261-49c2-b82e-d0e1daf2b25a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xezWdmJl {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xezWdmJl" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[915237f1-ef94-4520-ba67-a8de608b8464]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xezWdmJl'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[843cb214-38ec-4801-afd6-6e00cd4f3347]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9672466f-b4d0-4196-8185-cea32d20a03b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c5c452-73fe-48db-8d20-8f26aea02ecf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9, portal: 172.16.0.220,3260]
Aug 17 20:06:37 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9, portal: 172.16.0.220,3260] successful.
Aug 17 20:06:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c00679b-97b5-4f52-b361-6fb0515e9d0d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac7ec85-15e0-4e35-9b96-1d400e2974ac]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)
Aug 17 20:06:37 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c622ef7-fc02-4d99-97af-1fb254f87e37]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xezWdmJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:06:37 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Updating instance_info_cache with network_info: [{"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23230353464346135', 'path': '/dev/sdg'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230353464346135', 'path': '/dev/sdg'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG nova.objects.instance [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid fa0a87a2-9816-4aed-901d-1dff953f8046 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:06:38 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:06:38 user nova-compute[72815]:   <source dev="/dev/sdg"/>
Aug 17 20:06:38 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:06:38 user nova-compute[72815]:   <serial>a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9</serial>
Aug 17 20:06:38 user nova-compute[72815]: </disk>
Aug 17 20:06:38 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:06:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:06:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:06:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No VIF found with MAC fa:16:3e:23:f4:e4, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:06:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-689ff3bf-8d88-42a9-9bac-535fcde80aa6 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.367s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG nova.objects.instance [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid fa0a87a2-9816-4aed-901d-1dff953f8046 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:44 user nova-compute[72815]: INFO nova.compute.manager [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Attaching volume b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 to /dev/vdc
Aug 17 20:06:44 user nova-compute[72815]: DEBUG os_brick.utils [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[58228ea8-b55c-4fa6-a80f-7b0d740d4c7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dc8f40-2943-4e80-b9a2-6edccfc0e392]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c50ed0a-820b-4aac-839d-f52b12296d8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a97fcc9-2a70-429f-a6b7-2d21a19a6315]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:06:44 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:06:44 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e8518d-9f6b-4222-8a1f-4cde7d332df9]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG os_brick.utils [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:06:44 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Updating existing volume attachment record: ef02ec1e-7027-4904-8beb-41cd78f9f730 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:06:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:06:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:52 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:06:52 user nova-compute[72815]: INFO nova.compute.claims [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Claim successful on node user
Aug 17 20:06:52 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG nova.network.neutron [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:06:53 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:06:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG nova.policy [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c18f1cf89be4c63a7ad48ec390c6213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68603e63804620b9bacd300d254000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:06:53 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Creating image(s)
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "/opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "/opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.208s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk 1073741824" returned: 0 in 0.054s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG nova.network.neutron [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Successfully created port: 049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:06:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:54 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Cannot resize image /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:06:54 user nova-compute[72815]: DEBUG nova.objects.instance [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lazy-loading 'migration_context' on Instance uuid 8ac64ac9-a49d-4c70-956b-3a140da5ede8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:06:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Ensure instance console log exists: /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:06:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.network.neutron [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Successfully updated port: 049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "refresh_cache-8ac64ac9-a49d-4c70-956b-3a140da5ede8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquired lock "refresh_cache-8ac64ac9-a49d-4c70-956b-3a140da5ede8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.network.neutron [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.network.neutron [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:06:55 user nova-compute[72815]: INFO nova.compute.manager [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Rescuing
Aug 17 20:06:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "refresh_cache-caffa446-5b29-4c5d-b756-4cc7119676cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquired lock "refresh_cache-caffa446-5b29-4c5d-b756-4cc7119676cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a32dcf6-ce83-4738-b21b-6baab03b30fd req-c38b72d2-a7f4-4ee7-9848-94a5e2c5cb96 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Received event network-changed-049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a32dcf6-ce83-4738-b21b-6baab03b30fd req-c38b72d2-a7f4-4ee7-9848-94a5e2c5cb96 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Refreshing instance network info cache due to event network-changed-049f8926-a1a3-431c-bf28-d08348e98b73. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a32dcf6-ce83-4738-b21b-6baab03b30fd req-c38b72d2-a7f4-4ee7-9848-94a5e2c5cb96 service nova] Acquiring lock "refresh_cache-8ac64ac9-a49d-4c70-956b-3a140da5ede8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.network.neutron [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Updating instance_info_cache with network_info: [{"id": "049f8926-a1a3-431c-bf28-d08348e98b73", "address": "fa:16:3e:1f:94:21", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049f8926-a1", "ovs_interfaceid": "049f8926-a1a3-431c-bf28-d08348e98b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Releasing lock "refresh_cache-8ac64ac9-a49d-4c70-956b-3a140da5ede8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Instance network_info: |[{"id": "049f8926-a1a3-431c-bf28-d08348e98b73", "address": "fa:16:3e:1f:94:21", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049f8926-a1", "ovs_interfaceid": "049f8926-a1a3-431c-bf28-d08348e98b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a32dcf6-ce83-4738-b21b-6baab03b30fd req-c38b72d2-a7f4-4ee7-9848-94a5e2c5cb96 service nova] Acquired lock "refresh_cache-8ac64ac9-a49d-4c70-956b-3a140da5ede8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.network.neutron [req-3a32dcf6-ce83-4738-b21b-6baab03b30fd req-c38b72d2-a7f4-4ee7-9848-94a5e2c5cb96 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Refreshing network info cache for port 049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Start _get_guest_xml network_info=[{"id": "049f8926-a1a3-431c-bf28-d08348e98b73", "address": "fa:16:3e:1f:94:21", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049f8926-a1", "ovs_interfaceid": "049f8926-a1a3-431c-bf28-d08348e98b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:06:55 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:06:55 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-89461310',display_name='tempest-ServersNegativeTestJSON-server-89461310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-89461310',id=32,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d68603e63804620b9bacd300d254000',ramdisk_id='',reservation_id='r-lbwp2gxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-128301023',owner_user_name='tempest-ServersNegativeTestJSON-128301023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:06:53Z,user_data=None,user_id='1c18f1cf89be4c63a7ad48ec390c6213',uuid=8ac64ac9-a49d-4c70-956b-3a140da5ede8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "049f8926-a1a3-431c-bf28-d08348e98b73", "address": "fa:16:3e:1f:94:21", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049f8926-a1", "ovs_interfaceid": "049f8926-a1a3-431c-bf28-d08348e98b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Converting VIF {"id": "049f8926-a1a3-431c-bf28-d08348e98b73", "address": "fa:16:3e:1f:94:21", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049f8926-a1", "ovs_interfaceid": "049f8926-a1a3-431c-bf28-d08348e98b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:94:21,bridge_name='br-int',has_traffic_filtering=True,id=049f8926-a1a3-431c-bf28-d08348e98b73,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap049f8926-a1') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.objects.instance [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ac64ac9-a49d-4c70-956b-3a140da5ede8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:06:55 user nova-compute[72815]:   <uuid>8ac64ac9-a49d-4c70-956b-3a140da5ede8</uuid>
Aug 17 20:06:55 user nova-compute[72815]:   <name>instance-00000020</name>
Aug 17 20:06:55 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:06:55 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:06:55 user nova-compute[72815]:   <metadata>
Aug 17 20:06:55 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:06:55 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:06:55 user nova-compute[72815]:       <nova:name>tempest-ServersNegativeTestJSON-server-89461310</nova:name>
Aug 17 20:06:55 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:06:55</nova:creationTime>
Aug 17 20:06:55 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:06:55 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:06:55 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:06:55 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:06:55 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:06:55 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:06:55 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:06:55 user nova-compute[72815]:       <nova:owner>
Aug 17 20:06:55 user nova-compute[72815]:         <nova:user uuid="1c18f1cf89be4c63a7ad48ec390c6213">tempest-ServersNegativeTestJSON-128301023-project-member</nova:user>
Aug 17 20:06:55 user nova-compute[72815]:         <nova:project uuid="2d68603e63804620b9bacd300d254000">tempest-ServersNegativeTestJSON-128301023</nova:project>
Aug 17 20:06:55 user nova-compute[72815]:       </nova:owner>
Aug 17 20:06:55 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:06:55 user nova-compute[72815]:       <nova:ports>
Aug 17 20:06:55 user nova-compute[72815]:         <nova:port uuid="049f8926-a1a3-431c-bf28-d08348e98b73">
Aug 17 20:06:55 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 20:06:55 user nova-compute[72815]:         </nova:port>
Aug 17 20:06:55 user nova-compute[72815]:       </nova:ports>
Aug 17 20:06:55 user nova-compute[72815]:     </nova:instance>
Aug 17 20:06:55 user nova-compute[72815]:   </metadata>
Aug 17 20:06:55 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:06:55 user nova-compute[72815]:     <system>
Aug 17 20:06:55 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:06:55 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:06:55 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:06:55 user nova-compute[72815]:       <entry name="serial">8ac64ac9-a49d-4c70-956b-3a140da5ede8</entry>
Aug 17 20:06:55 user nova-compute[72815]:       <entry name="uuid">8ac64ac9-a49d-4c70-956b-3a140da5ede8</entry>
Aug 17 20:06:55 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:06:55 user nova-compute[72815]:     </system>
Aug 17 20:06:55 user nova-compute[72815]:   </sysinfo>
Aug 17 20:06:55 user nova-compute[72815]:   <os>
Aug 17 20:06:55 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:06:55 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:06:55 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:06:55 user nova-compute[72815]:   </os>
Aug 17 20:06:55 user nova-compute[72815]:   <features>
Aug 17 20:06:55 user nova-compute[72815]:     <acpi/>
Aug 17 20:06:55 user nova-compute[72815]:     <apic/>
Aug 17 20:06:55 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:06:55 user nova-compute[72815]:   </features>
Aug 17 20:06:55 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:06:55 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:06:55 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:06:55 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:06:55 user nova-compute[72815]:   </clock>
Aug 17 20:06:55 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:06:55 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:06:55 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:06:55 user nova-compute[72815]:   </cpu>
Aug 17 20:06:55 user nova-compute[72815]:   <devices>
Aug 17 20:06:55 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:06:55 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:06:55 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk"/>
Aug 17 20:06:55 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:06:55 user nova-compute[72815]:     </disk>
Aug 17 20:06:55 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:06:55 user nova-compute[72815]:       <mac address="fa:16:3e:1f:94:21"/>
Aug 17 20:06:55 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:06:55 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:06:55 user nova-compute[72815]:       <target dev="tap049f8926-a1"/>
Aug 17 20:06:55 user nova-compute[72815]:     </interface>
Aug 17 20:06:55 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:06:55 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/console.log" append="off"/>
Aug 17 20:06:55 user nova-compute[72815]:     </serial>
Aug 17 20:06:55 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:06:55 user nova-compute[72815]:     <video>
Aug 17 20:06:55 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:06:55 user nova-compute[72815]:     </video>
Aug 17 20:06:55 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:06:55 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:06:55 user nova-compute[72815]:     </rng>
Aug 17 20:06:55 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:06:55 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:06:55 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:06:55 user nova-compute[72815]:     </memballoon>
Aug 17 20:06:55 user nova-compute[72815]:   </devices>
Aug 17 20:06:55 user nova-compute[72815]: </domain>
Aug 17 20:06:55 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-89461310',display_name='tempest-ServersNegativeTestJSON-server-89461310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-89461310',id=32,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d68603e63804620b9bacd300d254000',ramdisk_id='',reservation_id='r-lbwp2gxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-128301023',owner_user_name='tempest-ServersNegativeTestJSON-128301023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:06:53Z,user_data=None,user_id='1c18f1cf89be4c63a7ad48ec390c6213',uuid=8ac64ac9-a49d-4c70-956b-3a140da5ede8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "049f8926-a1a3-431c-bf28-d08348e98b73", "address": "fa:16:3e:1f:94:21", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049f8926-a1", "ovs_interfaceid": "049f8926-a1a3-431c-bf28-d08348e98b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Converting VIF {"id": "049f8926-a1a3-431c-bf28-d08348e98b73", "address": "fa:16:3e:1f:94:21", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049f8926-a1", "ovs_interfaceid": "049f8926-a1a3-431c-bf28-d08348e98b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:94:21,bridge_name='br-int',has_traffic_filtering=True,id=049f8926-a1a3-431c-bf28-d08348e98b73,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap049f8926-a1') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG os_vif [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:94:21,bridge_name='br-int',has_traffic_filtering=True,id=049f8926-a1a3-431c-bf28-d08348e98b73,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap049f8926-a1') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap049f8926-a1, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap049f8926-a1, col_values=(('external_ids', {'iface-id': '049f8926-a1a3-431c-bf28-d08348e98b73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:94:21', 'vm-uuid': '8ac64ac9-a49d-4c70-956b-3a140da5ede8'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:55 user nova-compute[72815]: INFO os_vif [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:94:21,bridge_name='br-int',has_traffic_filtering=True,id=049f8926-a1a3-431c-bf28-d08348e98b73,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap049f8926-a1')
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:06:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] No VIF found with MAC fa:16:3e:1f:94:21, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG nova.network.neutron [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Updating instance_info_cache with network_info: [{"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Releasing lock "refresh_cache-caffa446-5b29-4c5d-b756-4cc7119676cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-3a32dcf6-ce83-4738-b21b-6baab03b30fd req-c38b72d2-a7f4-4ee7-9848-94a5e2c5cb96 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Updated VIF entry in instance network info cache for port 049f8926-a1a3-431c-bf28-d08348e98b73. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-3a32dcf6-ce83-4738-b21b-6baab03b30fd req-c38b72d2-a7f4-4ee7-9848-94a5e2c5cb96 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Updating instance_info_cache with network_info: [{"id": "049f8926-a1a3-431c-bf28-d08348e98b73", "address": "fa:16:3e:1f:94:21", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049f8926-a1", "ovs_interfaceid": "049f8926-a1a3-431c-bf28-d08348e98b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a32dcf6-ce83-4738-b21b-6baab03b30fd req-c38b72d2-a7f4-4ee7-9848-94a5e2c5cb96 service nova] Releasing lock "refresh_cache-8ac64ac9-a49d-4c70-956b-3a140da5ede8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-3f8d8b73-05c8-4012-8fd2-04faa4ae12bf req-233d39ed-4349-46ff-bc87-d632c849c3db service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-unplugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3f8d8b73-05c8-4012-8fd2-04faa4ae12bf req-233d39ed-4349-46ff-bc87-d632c849c3db service nova] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3f8d8b73-05c8-4012-8fd2-04faa4ae12bf req-233d39ed-4349-46ff-bc87-d632c849c3db service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3f8d8b73-05c8-4012-8fd2-04faa4ae12bf req-233d39ed-4349-46ff-bc87-d632c849c3db service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-3f8d8b73-05c8-4012-8fd2-04faa4ae12bf req-233d39ed-4349-46ff-bc87-d632c849c3db service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] No waiting events found dispatching network-vif-unplugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:06:56 user nova-compute[72815]: WARNING nova.compute.manager [req-3f8d8b73-05c8-4012-8fd2-04faa4ae12bf req-233d39ed-4349-46ff-bc87-d632c849c3db service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received unexpected event network-vif-unplugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 for instance with vm_state active and task_state rescuing.
Aug 17 20:06:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEzuiZeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:06:57 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:06:57 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:06:57 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b268d9c3-1cf8-4036-b1a2-cfdd3a89cd08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:06:57 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb7d7d3-758a-4d24-8917-a005ff726784]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2] added
Aug 17 20:06:57 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[65254116-868b-4c69-bef7-3bd8ce4a5c1c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[226b2464-3684-45e4-b227-eaee50c47b21]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEzuiZeS {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:57 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Instance destroyed successfully.
Aug 17 20:06:57 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Attempting a stable device rescue
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEzuiZeS" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c66fd39-4ad2-4275-bb3b-e4b4b62ad40e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UEzuiZeS'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dc933b-7de6-432f-8e5d-356c9252e1eb]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72815) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Instance directory exists: not creating {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 20:06:57 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Creating image(s)
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "/opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "/opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "/opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'trusted_certs' on Instance uuid caffa446-5b29-4c5d-b756-4cc7119676cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb533bf-1c25-41c5-857b-47b86b1211a8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:06:57 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:06:57 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:06:57 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:06:57 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:06:57 user nova-compute[72815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)
Aug 17 20:06:57 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:06:57 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:06:57 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:06:57 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:06:57 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:06:57 user nova-compute[72815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)
Aug 17 20:06:57 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "287ac792923b8163b8ca571f6462a7a74e9ad3dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "287ac792923b8163b8ca571f6462a7a74e9ad3dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72069b1d-bd17-4e47-9d38-546229b9086d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2, portal: 172.16.0.220,3260]
Aug 17 20:06:57 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2, portal: 172.16.0.220,3260] successful.
Aug 17 20:06:57 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dd3edf-6c09-446d-8db0-3d791798180d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd.part --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1627a4f-6747-49ef-825f-152dea9dda0e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-7e21806c-71fc-4ce0-bd16-527c1c2b61ae req-d93d857b-7282-4f1c-9d89-c28aefbbce20 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Received event network-vif-plugged-049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7e21806c-71fc-4ce0-bd16-527c1c2b61ae req-d93d857b-7282-4f1c-9d89-c28aefbbce20 service nova] Acquiring lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7e21806c-71fc-4ce0-bd16-527c1c2b61ae req-d93d857b-7282-4f1c-9d89-c28aefbbce20 service nova] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7e21806c-71fc-4ce0-bd16-527c1c2b61ae req-d93d857b-7282-4f1c-9d89-c28aefbbce20 service nova] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-7e21806c-71fc-4ce0-bd16-527c1c2b61ae req-d93d857b-7282-4f1c-9d89-c28aefbbce20 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] No waiting events found dispatching network-vif-plugged-049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:06:58 user nova-compute[72815]: WARNING nova.compute.manager [req-7e21806c-71fc-4ce0-bd16-527c1c2b61ae req-d93d857b-7282-4f1c-9d89-c28aefbbce20 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Received unexpected event network-vif-plugged-049f8926-a1a3-431c-bf28-d08348e98b73 for instance with vm_state building and task_state spawning.
Aug 17 20:06:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-f9f4d2f1-9e8c-4eaa-bb0d-7abc9634397f req-1170f444-c934-46e2-8fe2-2f0b220a811b service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f9f4d2f1-9e8c-4eaa-bb0d-7abc9634397f req-1170f444-c934-46e2-8fe2-2f0b220a811b service nova] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f9f4d2f1-9e8c-4eaa-bb0d-7abc9634397f req-1170f444-c934-46e2-8fe2-2f0b220a811b service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f9f4d2f1-9e8c-4eaa-bb0d-7abc9634397f req-1170f444-c934-46e2-8fe2-2f0b220a811b service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-f9f4d2f1-9e8c-4eaa-bb0d-7abc9634397f req-1170f444-c934-46e2-8fe2-2f0b220a811b service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] No waiting events found dispatching network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:06:58 user nova-compute[72815]: WARNING nova.compute.manager [req-f9f4d2f1-9e8c-4eaa-bb0d-7abc9634397f req-1170f444-c934-46e2-8fe2-2f0b220a811b service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received unexpected event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 for instance with vm_state active and task_state rescuing.
Aug 17 20:06:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:06:58 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:06:58 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:06:58 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:06:58 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:06:58 user nova-compute[72815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)
Aug 17 20:06:58 user nova-compute[72815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 (non-flash)
Aug 17 20:06:58 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:06:58 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:06:58 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:06:58 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:06:58 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:06:58 user nova-compute[72815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)
Aug 17 20:06:58 user nova-compute[72815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 (non-flash)
Aug 17 20:06:58 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.536s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] HCTL ('39', '-', '-', 0) found on session 37 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a81b0a-e27c-40e5-a679-04444d8494fd]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd.part --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG nova.virt.images [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] 56829976-d690-420b-9187-d3b476b20bef was qcow2, converting to raw {{(pid=72815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 20:06:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd.part /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd.converted {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd.part /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd.converted" returned: 0 in 0.408s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd.converted --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "287ac792923b8163b8ca571f6462a7a74e9ad3dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.042s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "287ac792923b8163b8ca571f6462a7a74e9ad3dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "287ac792923b8163b8ca571f6462a7a74e9ad3dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd --force-share --output=json" returned: 0 in 0.172s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd,backing_fmt=raw /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.rescue {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.compute.manager [req-9d8c5621-8b7f-42e9-ad21-d5086e7efcba req-cdcb55b3-3d08-4ff8-a699-083809b675cf service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Received event network-vif-plugged-049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9d8c5621-8b7f-42e9-ad21-d5086e7efcba req-cdcb55b3-3d08-4ff8-a699-083809b675cf service nova] Acquiring lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9d8c5621-8b7f-42e9-ad21-d5086e7efcba req-cdcb55b3-3d08-4ff8-a699-083809b675cf service nova] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9d8c5621-8b7f-42e9-ad21-d5086e7efcba req-cdcb55b3-3d08-4ff8-a699-083809b675cf service nova] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.compute.manager [req-9d8c5621-8b7f-42e9-ad21-d5086e7efcba req-cdcb55b3-3d08-4ff8-a699-083809b675cf service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] No waiting events found dispatching network-vif-plugged-049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:06:59 user nova-compute[72815]: WARNING nova.compute.manager [req-9d8c5621-8b7f-42e9-ad21-d5086e7efcba req-cdcb55b3-3d08-4ff8-a699-083809b675cf service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Received unexpected event network-vif-plugged-049f8926-a1a3-431c-bf28-d08348e98b73 for instance with vm_state building and task_state spawning.
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd,backing_fmt=raw /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.rescue" returned: 0 in 0.061s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "287ac792923b8163b8ca571f6462a7a74e9ad3dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'migration_context' on Instance uuid caffa446-5b29-4c5d-b756-4cc7119676cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Start _get_guest_xml network_info=[{"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "vif_mac": "fa:16:3e:45:fd:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '56829976-d690-420b-9187-d3b476b20bef', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': 'ed1a6328-4701-4472-a844-145df1b65fb6', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaCkUeRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'caffa446-5b29-4c5d-b756-4cc7119676cf', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9f313bf-5497-49a4-836b-79e22cbf75a2', 'serial': 'e9f313bf-5497-49a4-836b-79e22cbf75a2'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'resources' on Instance uuid caffa446-5b29-4c5d-b756-4cc7119676cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEzuiZeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.569s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] <== connect_volume: return (2571ms) {'type': 'block', 'scsi_wwn': '23736613339323339', 'path': '/dev/sdh'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736613339323339', 'path': '/dev/sdh'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'numa_topology' on Instance uuid caffa446-5b29-4c5d-b756-4cc7119676cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.objects.instance [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid fa0a87a2-9816-4aed-901d-1dff953f8046 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:59 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:06:59 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'vcpu_model' on Instance uuid caffa446-5b29-4c5d-b756-4cc7119676cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302819.8339546, 8ac64ac9-a49d-4c70-956b-3a140da5ede8 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:06:59 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] VM Resumed (Lifecycle Event)
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaCkUeRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:06:59 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:06:59 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:06:59 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:06:59 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:06:59 user nova-compute[72815]:   <source dev="/dev/sdh"/>
Aug 17 20:06:59 user nova-compute[72815]:   <target dev="vdc" bus="virtio"/>
Aug 17 20:06:59 user nova-compute[72815]:   <serial>b7abd890-0eba-4ff5-aa98-f9bd79a36ea2</serial>
Aug 17 20:06:59 user nova-compute[72815]: </disk>
Aug 17 20:06:59 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:59 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Instance spawned successfully.
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5302b4-78a8-4783-a2a3-ab06b24f61a3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JaCkUeRE\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 20:06:59 user nova-compute[72815]: node.name = iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2
Aug 17 20:06:59 user nova-compute[72815]: node.tpgt = -1
Aug 17 20:06:59 user nova-compute[72815]: node.startup = automatic
Aug 17 20:06:59 user nova-compute[72815]: node.leading_login = No
Aug 17 20:06:59 user nova-compute[72815]: iface.iscsi_ifacename = default
Aug 17 20:06:59 user nova-compute[72815]: iface.net_ifacename = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.ipaddress = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.prefix_len = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.hwaddress = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.transport_name = tcp
Aug 17 20:06:59 user nova-compute[72815]: iface.initiatorname = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.state = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.vlan_id = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.vlan_priority = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.vlan_state = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.iface_num = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.mtu = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.port = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.bootproto = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.subnet_mask = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.gateway = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.dhcp_alt_client_id = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.dhcp_dns = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.dhcp_learn_iqn = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.dhcp_vendor_id_state = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.dhcp_vendor_id = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.dhcp_slp_da = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.fragmentation = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.gratuitous_arp = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.incoming_forwarding = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.tos_state = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.tos = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.ttl = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.delayed_ack = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.tcp_nagle = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.tcp_wsf_state = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.tcp_wsf = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.tcp_timer_scale = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.tcp_timestamp = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.redirect = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.def_task_mgmt_timeout = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.header_digest = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.data_digest = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.immediate_data = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.initial_r2t = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.data_seq_inorder = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.data_pdu_inorder = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.erl = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.max_receive_data_len = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.first_burst_len = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.max_outstanding_r2t = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.max_burst_len = 0
Aug 17 20:06:59 user nova-compute[72815]: iface.chap_auth = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.bidi_chap = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.strict_login_compliance = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.discovery_auth = <empty>
Aug 17 20:06:59 user nova-compute[72815]: iface.discovery_logout = <empty>
Aug 17 20:06:59 user nova-compute[72815]: node.discovery_address = <empty>
Aug 17 20:06:59 user nova-compute[72815]: node.discovery_port = 0
Aug 17 20:06:59 user nova-compute[72815]: node.discovery_type = static
Aug 17 20:06:59 user nova-compute[72815]: node.session.initial_cmdsn = 0
Aug 17 20:06:59 user nova-compute[72815]: node.session.initial_login_retry_max = 8
Aug 17 20:06:59 user nova-compute[72815]: node.session.xmit_thread_priority = -20
Aug 17 20:06:59 user nova-compute[72815]: node.session.cmds_max = 128
Aug 17 20:06:59 user nova-compute[72815]: node.session.queue_depth = 32
Aug 17 20:06:59 user nova-compute[72815]: node.session.nr_sessions = 1
Aug 17 20:06:59 user nova-compute[72815]: node.session.auth.authmethod = CHAP
Aug 17 20:06:59 user nova-compute[72815]: node.session.auth.username = JaCkUeRE
Aug 17 20:06:59 user nova-compute[72815]: node.session.auth.password = ***
Aug 17 20:06:59 user nova-compute[72815]: node.session.auth.username_in = <empty>
Aug 17 20:06:59 user nova-compute[72815]: node.session.auth.password_in = <empty>
Aug 17 20:06:59 user nova-compute[72815]: node.session.auth.chap_algs = MD5
Aug 17 20:06:59 user nova-compute[72815]: node.session.timeo.replacement_timeout = 120
Aug 17 20:06:59 user nova-compute[72815]: node.session.err_timeo.abort_timeout = 15
Aug 17 20:06:59 user nova-compute[72815]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 20:06:59 user nova-compute[72815]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 20:06:59 user nova-compute[72815]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 20:06:59 user nova-compute[72815]: node.session.iscsi.FastAbort = Yes
Aug 17 20:06:59 user nova-compute[72815]: node.session.iscsi.InitialR2T = No
Aug 17 20:06:59 user nova-compute[72815]: node.session.iscsi.ImmediateData = Yes
Aug 17 20:06:59 user nova-compute[72815]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 20:06:59 user nova-compute[72815]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 20:06:59 user nova-compute[72815]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 20:06:59 user nova-compute[72815]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 20:06:59 user nova-compute[72815]: node.session.iscsi.MaxConnections = 1
Aug 17 20:06:59 user nova-compute[72815]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 20:06:59 user nova-compute[72815]: node.session.iscsi.ERL = 0
Aug 17 20:06:59 user nova-compute[72815]: node.session.scan = manual
Aug 17 20:06:59 user nova-compute[72815]: node.session.reopen_max = 0
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].address = 172.16.0.220
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].port = 3260
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].startup = manual
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].tcp.window_size = 524288
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].tcp.type_of_service = 0
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].timeo.logout_timeout = 15
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].timeo.login_timeout = 15
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].timeo.auth_timeout = 45
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].iscsi.DataDigest = None
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].iscsi.IFMarker = No
Aug 17 20:06:59 user nova-compute[72815]: node.conn[0].iscsi.OFMarker = No
Aug 17 20:06:59 user nova-compute[72815]: # END RECORD
Aug 17 20:06:59 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:59 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302819.835081, 8ac64ac9-a49d-4c70-956b-3a140da5ede8 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:06:59 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] VM Started (Lifecycle Event)
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9337bf-a56c-4b6e-b5f1-7a47b0cdba2b]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ffa5c1-d566-48c9-9c76-444eddba3765]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaCkUeRE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:06:59 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaCkUeRE" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb62b9a6-a60d-4337-8e7e-5cb8e6f7d5c4]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JaCkUeRE'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:06:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bfad4f-ce75-4814-8135-3efde7410031]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:00 user nova-compute[72815]: INFO nova.compute.manager [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Took 6.78 seconds to spawn the instance on the hypervisor.
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bb8796-b6f4-44a2-a361-b10295a165f3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:00 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:00 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:07:00 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:00 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:07:00 user nova-compute[72815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)
Aug 17 20:07:00 user nova-compute[72815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 (non-flash)
Aug 17 20:07:00 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:00 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:00 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:07:00 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:00 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:07:00 user nova-compute[72815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)
Aug 17 20:07:00 user nova-compute[72815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 (non-flash)
Aug 17 20:07:00 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.195s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] HCTL ('33', '0', '0', 0) found on session 32 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd26156b-e9d9-44eb-ad7c-0110f704b5bb]: (4, ('0 0 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Searching for a device in session 32 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaCkUeRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.219s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] <== connect_volume: return (220ms) {'type': 'block', 'scsi_wwn': '26135386362616236', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135386362616236', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1142280768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1142280768',id=27,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:05:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-xdar94bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:05:33Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=caffa446-5b29-4c5d-b756-4cc7119676cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "vif_mac": "fa:16:3e:45:fd:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "vif_mac": "fa:16:3e:45:fd:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:fd:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdd534e6-dcf7-4ddc-8654-5140e12727b0,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd534e6-dc') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'pci_devices' on Instance uuid caffa446-5b29-4c5d-b756-4cc7119676cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:00 user nova-compute[72815]: INFO nova.compute.manager [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Took 7.65 seconds to build instance.
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:07:00 user nova-compute[72815]:   <uuid>caffa446-5b29-4c5d-b756-4cc7119676cf</uuid>
Aug 17 20:07:00 user nova-compute[72815]:   <name>instance-0000001b</name>
Aug 17 20:07:00 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:07:00 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:07:00 user nova-compute[72815]:   <metadata>
Aug 17 20:07:00 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:07:00 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:07:00 user nova-compute[72815]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1142280768</nova:name>
Aug 17 20:07:00 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:06:59</nova:creationTime>
Aug 17 20:07:00 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:07:00 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:07:00 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:07:00 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:07:00 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:07:00 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:07:00 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:07:00 user nova-compute[72815]:       <nova:owner>
Aug 17 20:07:00 user nova-compute[72815]:         <nova:user uuid="169121564e514d4f883b71abeb3e6070">tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member</nova:user>
Aug 17 20:07:00 user nova-compute[72815]:         <nova:project uuid="89c20bd5232b4b058abc1b50f38cade3">tempest-ServerBootFromVolumeStableRescueTest-264619992</nova:project>
Aug 17 20:07:00 user nova-compute[72815]:       </nova:owner>
Aug 17 20:07:00 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:07:00 user nova-compute[72815]:       <nova:ports>
Aug 17 20:07:00 user nova-compute[72815]:         <nova:port uuid="cdd534e6-dcf7-4ddc-8654-5140e12727b0">
Aug 17 20:07:00 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 20:07:00 user nova-compute[72815]:         </nova:port>
Aug 17 20:07:00 user nova-compute[72815]:       </nova:ports>
Aug 17 20:07:00 user nova-compute[72815]:     </nova:instance>
Aug 17 20:07:00 user nova-compute[72815]:   </metadata>
Aug 17 20:07:00 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:07:00 user nova-compute[72815]:     <system>
Aug 17 20:07:00 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:07:00 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:07:00 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:07:00 user nova-compute[72815]:       <entry name="serial">caffa446-5b29-4c5d-b756-4cc7119676cf</entry>
Aug 17 20:07:00 user nova-compute[72815]:       <entry name="uuid">caffa446-5b29-4c5d-b756-4cc7119676cf</entry>
Aug 17 20:07:00 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:07:00 user nova-compute[72815]:     </system>
Aug 17 20:07:00 user nova-compute[72815]:   </sysinfo>
Aug 17 20:07:00 user nova-compute[72815]:   <os>
Aug 17 20:07:00 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:07:00 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:07:00 user nova-compute[72815]:   </os>
Aug 17 20:07:00 user nova-compute[72815]:   <features>
Aug 17 20:07:00 user nova-compute[72815]:     <acpi/>
Aug 17 20:07:00 user nova-compute[72815]:     <apic/>
Aug 17 20:07:00 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:07:00 user nova-compute[72815]:   </features>
Aug 17 20:07:00 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:07:00 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:07:00 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:07:00 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:07:00 user nova-compute[72815]:   </clock>
Aug 17 20:07:00 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:07:00 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:07:00 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:07:00 user nova-compute[72815]:   </cpu>
Aug 17 20:07:00 user nova-compute[72815]:   <devices>
Aug 17 20:07:00 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:07:00 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:07:00 user nova-compute[72815]:       <source dev="/dev/sdb"/>
Aug 17 20:07:00 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:07:00 user nova-compute[72815]:       <serial>e9f313bf-5497-49a4-836b-79e22cbf75a2</serial>
Aug 17 20:07:00 user nova-compute[72815]:     </disk>
Aug 17 20:07:00 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:07:00 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:07:00 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.rescue"/>
Aug 17 20:07:00 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 20:07:00 user nova-compute[72815]:       <boot order="1"/>
Aug 17 20:07:00 user nova-compute[72815]:     </disk>
Aug 17 20:07:00 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:07:00 user nova-compute[72815]:       <mac address="fa:16:3e:45:fd:f8"/>
Aug 17 20:07:00 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:07:00 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:07:00 user nova-compute[72815]:       <target dev="tapcdd534e6-dc"/>
Aug 17 20:07:00 user nova-compute[72815]:     </interface>
Aug 17 20:07:00 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:07:00 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/console.log" append="off"/>
Aug 17 20:07:00 user nova-compute[72815]:     </serial>
Aug 17 20:07:00 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:07:00 user nova-compute[72815]:     <video>
Aug 17 20:07:00 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:07:00 user nova-compute[72815]:     </video>
Aug 17 20:07:00 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:07:00 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:07:00 user nova-compute[72815]:     </rng>
Aug 17 20:07:00 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:07:00 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:07:00 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:07:00 user nova-compute[72815]:     </memballoon>
Aug 17 20:07:00 user nova-compute[72815]:   </devices>
Aug 17 20:07:00 user nova-compute[72815]: </domain>
Aug 17 20:07:00 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-287a4fdb-0e84-4159-8c50-4ac1be42eda0 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.769s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:00 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Instance destroyed successfully.
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] No VIF found with MAC fa:16:3e:45:fd:f8, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] No VIF found with MAC fa:16:3e:23:f4:e4, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b4e998ad-b422-47d9-a679-e451aa5c2f2b tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.158s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:01 user nova-compute[72815]: INFO nova.compute.manager [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Detaching volume a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9
Aug 17 20:07:01 user nova-compute[72815]: INFO nova.virt.block_device [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Attempting to driver detach volume a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 from mountpoint /dev/vdb
Aug 17 20:07:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Attempting to detach device vdb from instance fa0a87a2-9816-4aed-901d-1dff953f8046 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:07:01 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:07:01 user nova-compute[72815]:   <source dev="/dev/sdg"/>
Aug 17 20:07:01 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:07:01 user nova-compute[72815]:   <serial>a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9</serial>
Aug 17 20:07:01 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:07:01 user nova-compute[72815]: </disk>
Aug 17 20:07:01 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:07:01 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully detached device vdb from instance fa0a87a2-9816-4aed-901d-1dff953f8046 from the persistent domain config.
Aug 17 20:07:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa0a87a2-9816-4aed-901d-1dff953f8046 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:07:01 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:07:01 user nova-compute[72815]:   <source dev="/dev/sdg"/>
Aug 17 20:07:01 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:07:01 user nova-compute[72815]:   <serial>a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9</serial>
Aug 17 20:07:01 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:07:01 user nova-compute[72815]: </disk>
Aug 17 20:07:01 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-4d6a765c-660e-4ad9-a93f-cc8dd5bb3400 req-94feab42-ee05-4029-97ed-012ddacafa4d service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4d6a765c-660e-4ad9-a93f-cc8dd5bb3400 req-94feab42-ee05-4029-97ed-012ddacafa4d service nova] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4d6a765c-660e-4ad9-a93f-cc8dd5bb3400 req-94feab42-ee05-4029-97ed-012ddacafa4d service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4d6a765c-660e-4ad9-a93f-cc8dd5bb3400 req-94feab42-ee05-4029-97ed-012ddacafa4d service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-4d6a765c-660e-4ad9-a93f-cc8dd5bb3400 req-94feab42-ee05-4029-97ed-012ddacafa4d service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] No waiting events found dispatching network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:01 user nova-compute[72815]: WARNING nova.compute.manager [req-4d6a765c-660e-4ad9-a93f-cc8dd5bb3400 req-94feab42-ee05-4029-97ed-012ddacafa4d service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received unexpected event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 for instance with vm_state active and task_state rescuing.
Aug 17 20:07:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302821.9259515, fa0a87a2-9816-4aed-901d-1dff953f8046 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa0a87a2-9816-4aed-901d-1dff953f8046 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:07:01 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully detached device vdb from instance fa0a87a2-9816-4aed-901d-1dff953f8046 from the live domain config.
Aug 17 20:07:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xezWdmJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:07:01 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:07:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ea67e2-8fd3-491d-a128-08132e127472]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5955e2-02ae-4706-9383-307f7de3ef57]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:02 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:02 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:07:02 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:02 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:07:02 user nova-compute[72815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)
Aug 17 20:07:02 user nova-compute[72815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 (non-flash)
Aug 17 20:07:02 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:02 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:02 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:07:02 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:02 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:07:02 user nova-compute[72815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 (non-flash)
Aug 17 20:07:02 user nova-compute[72815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 (non-flash)
Aug 17 20:07:02 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b430b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9'): ({'sdg'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Removing single pathed devices sdg {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4e8215-54e1-4893-b744-e319a081468f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[30af2d86-b798-4f7b-b794-6a209c72a3ff]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Flushing IO for device /dev/sdg {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa483a94-ff80-49c4-9a83-7f05b202f988]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7932ce80-ff46-4ef6-a9ce-000a270f9d3f]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] SCSI volumes sdg have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb3b467-5b84-4da9-bf1a-41a1c18b2d0c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[380084bc-fc49-49a5-83ae-5f3dba5a0c9f]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9, portal: 172.16.0.220,3260]
Aug 17 20:07:02 user nova-compute[72815]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9, portal: 172.16.0.220,3260] successful.
Aug 17 20:07:02 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37aab2a-09a3-4fcb-8d76-5eba3d6ee4a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ed1c74-6b60-48d9-82fe-68f2231411dc]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] <== disconnect_volume: return (348ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:07:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:07:03 user nova-compute[72815]: DEBUG nova.objects.instance [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid fa0a87a2-9816-4aed-901d-1dff953f8046 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-def69358-c168-460b-b39d-737d922da97c tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.287s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-c0f67a90-bbcb-4cae-9b36-b908c0d99f1e req-6be9f5c3-01ef-4ca7-b180-4b9dabfa0d4e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c0f67a90-bbcb-4cae-9b36-b908c0d99f1e req-6be9f5c3-01ef-4ca7-b180-4b9dabfa0d4e service nova] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c0f67a90-bbcb-4cae-9b36-b908c0d99f1e req-6be9f5c3-01ef-4ca7-b180-4b9dabfa0d4e service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c0f67a90-bbcb-4cae-9b36-b908c0d99f1e req-6be9f5c3-01ef-4ca7-b180-4b9dabfa0d4e service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-c0f67a90-bbcb-4cae-9b36-b908c0d99f1e req-6be9f5c3-01ef-4ca7-b180-4b9dabfa0d4e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] No waiting events found dispatching network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:03 user nova-compute[72815]: WARNING nova.compute.manager [req-c0f67a90-bbcb-4cae-9b36-b908c0d99f1e req-6be9f5c3-01ef-4ca7-b180-4b9dabfa0d4e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received unexpected event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 for instance with vm_state active and task_state rescuing.
Aug 17 20:07:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for caffa446-5b29-4c5d-b756-4cc7119676cf due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 20:07:04 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302824.3141122, caffa446-5b29-4c5d-b756-4cc7119676cf => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:07:04 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] VM Resumed (Lifecycle Event)
Aug 17 20:07:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-a315ad1a-af9a-40e1-b297-a7ab78fddc6f tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:07:04 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 20:07:04 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302824.3212378, caffa446-5b29-4c5d-b756-4cc7119676cf => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:07:04 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] VM Started (Lifecycle Event)
Aug 17 20:07:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:07:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:04 user nova-compute[72815]: INFO nova.compute.manager [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Detaching volume b7abd890-0eba-4ff5-aa98-f9bd79a36ea2
Aug 17 20:07:04 user nova-compute[72815]: INFO nova.virt.block_device [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Attempting to driver detach volume b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 from mountpoint /dev/vdc
Aug 17 20:07:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Attempting to detach device vdc from instance fa0a87a2-9816-4aed-901d-1dff953f8046 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:07:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:07:04 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:07:04 user nova-compute[72815]:   <source dev="/dev/sdh"/>
Aug 17 20:07:04 user nova-compute[72815]:   <target dev="vdc" bus="virtio"/>
Aug 17 20:07:04 user nova-compute[72815]:   <serial>b7abd890-0eba-4ff5-aa98-f9bd79a36ea2</serial>
Aug 17 20:07:04 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 20:07:04 user nova-compute[72815]: </disk>
Aug 17 20:07:04 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:07:04 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully detached device vdc from instance fa0a87a2-9816-4aed-901d-1dff953f8046 from the persistent domain config.
Aug 17 20:07:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance fa0a87a2-9816-4aed-901d-1dff953f8046 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:07:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:07:04 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:07:04 user nova-compute[72815]:   <source dev="/dev/sdh"/>
Aug 17 20:07:04 user nova-compute[72815]:   <target dev="vdc" bus="virtio"/>
Aug 17 20:07:04 user nova-compute[72815]:   <serial>b7abd890-0eba-4ff5-aa98-f9bd79a36ea2</serial>
Aug 17 20:07:04 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 20:07:04 user nova-compute[72815]: </disk>
Aug 17 20:07:04 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302825.164375, fa0a87a2-9816-4aed-901d-1dff953f8046 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance fa0a87a2-9816-4aed-901d-1dff953f8046 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:07:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully detached device vdc from instance fa0a87a2-9816-4aed-901d-1dff953f8046 from the live domain config.
Aug 17 20:07:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEzuiZeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:07:05 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df758c1-3975-4ddd-abc4-3bb4d5f3cf3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc226b9e-8717-4954-b1e8-f82146f7c7b9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:05 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:05 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:07:05 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:05 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:07:05 user nova-compute[72815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 (non-flash)
Aug 17 20:07:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:05 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:05 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:07:05 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:05 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:07:05 user nova-compute[72815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 (non-flash)
Aug 17 20:07:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399444ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2'): ({'sdh'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Removing single pathed devices sdh {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd61f38-e4b4-49e8-aff0-ba4b122f2af5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93ff8b4-c77b-4dce-9d6e-e7ba46bd5127]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Flushing IO for device /dev/sdh {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcd92d4-354c-4f8f-8bba-ce438f3bd11e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c545a9f9-e85f-49bc-9d36-6107b984fafa]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] SCSI volumes sdh have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cb1122-869e-4b88-8fda-df4383aca653]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.108s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0471a145-0ca9-4c92-a327-96c48420a8b0]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2, portal: 172.16.0.220,3260]
Aug 17 20:07:05 user nova-compute[72815]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2, portal: 172.16.0.220,3260] successful.
Aug 17 20:07:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7abd890-0eba-4ff5-aa98-f9bd79a36ea2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b0e5ca-b7b1-4ac5-b72a-8732d3de28fd]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] <== disconnect_volume: return (385ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:07:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:06 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'flavor' on Instance uuid fa0a87a2-9816-4aed-901d-1dff953f8046 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6337c60c-3725-4637-81de-192852ddaa13 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.867s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:07 user nova-compute[72815]: INFO nova.compute.manager [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Terminating instance
Aug 17 20:07:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-28071093-2650-4adf-b466-09eca9fe4616 req-2dba8f7d-497a-4041-9a36-0137835af1c0 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-vif-unplugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-28071093-2650-4adf-b466-09eca9fe4616 req-2dba8f7d-497a-4041-9a36-0137835af1c0 service nova] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-28071093-2650-4adf-b466-09eca9fe4616 req-2dba8f7d-497a-4041-9a36-0137835af1c0 service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-28071093-2650-4adf-b466-09eca9fe4616 req-2dba8f7d-497a-4041-9a36-0137835af1c0 service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-28071093-2650-4adf-b466-09eca9fe4616 req-2dba8f7d-497a-4041-9a36-0137835af1c0 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] No waiting events found dispatching network-vif-unplugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-28071093-2650-4adf-b466-09eca9fe4616 req-2dba8f7d-497a-4041-9a36-0137835af1c0 service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-vif-unplugged-97b110e2-ceca-4ed9-8886-8d7d2149339f for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:08 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Instance destroyed successfully.
Aug 17 20:07:08 user nova-compute[72815]: DEBUG nova.objects.instance [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lazy-loading 'resources' on Instance uuid fa0a87a2-9816-4aed-901d-1dff953f8046 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1294064360',display_name='tempest-AttachVolumeTestJSON-server-1294064360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1294064360',id=26,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmEO0HP9Il7TVGdcBd3B0rocuuBBbVK8yrlZ7tHCYbGATPKjGALRLpNygosPR3bhkKJFBWaKs4CbAu58gTuCWYKBQSSsij75fZQuC7aYCG0WsI42+MTIBEtrjmmKpnXQw==',key_name='tempest-keypair-2014358242',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:04:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb016b8ab299475e9f916809c7b55182',ramdisk_id='',reservation_id='r-kf17bhmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1462912324',owner_user_name='tempest-AttachVolumeTestJSON-1462912324-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:04:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c894534b34d943229dc89f6d58836acb',uuid=fa0a87a2-9816-4aed-901d-1dff953f8046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "address": "fa:16:3e:23:f4:e4", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b110e2-ce", "ovs_interfaceid": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converting VIF {"id": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "address": "fa:16:3e:23:f4:e4", "network": {"id": "b1cb8787-550d-4818-ad15-65ccba75e018", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1693894761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb016b8ab299475e9f916809c7b55182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b110e2-ce", "ovs_interfaceid": "97b110e2-ceca-4ed9-8886-8d7d2149339f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:e4,bridge_name='br-int',has_traffic_filtering=True,id=97b110e2-ceca-4ed9-8886-8d7d2149339f,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b110e2-ce') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG os_vif [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:e4,bridge_name='br-int',has_traffic_filtering=True,id=97b110e2-ceca-4ed9-8886-8d7d2149339f,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b110e2-ce') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97b110e2-ce, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:07:08 user nova-compute[72815]: INFO os_vif [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:e4,bridge_name='br-int',has_traffic_filtering=True,id=97b110e2-ceca-4ed9-8886-8d7d2149339f,network=Network(b1cb8787-550d-4818-ad15-65ccba75e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b110e2-ce')
Aug 17 20:07:08 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Deleting instance files /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046_del
Aug 17 20:07:08 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Deletion of /opt/stack/data/nova/instances/fa0a87a2-9816-4aed-901d-1dff953f8046_del complete
Aug 17 20:07:08 user nova-compute[72815]: INFO nova.compute.manager [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 17 20:07:08 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:07:08 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] No waiting events found dispatching network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:09 user nova-compute[72815]: WARNING nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received unexpected event network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f for instance with vm_state active and task_state deleting.
Aug 17 20:07:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] No waiting events found dispatching network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:09 user nova-compute[72815]: WARNING nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received unexpected event network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f for instance with vm_state active and task_state deleting.
Aug 17 20:07:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] No waiting events found dispatching network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:09 user nova-compute[72815]: WARNING nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received unexpected event network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f for instance with vm_state active and task_state deleting.
Aug 17 20:07:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-vif-unplugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] No waiting events found dispatching network-vif-unplugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-vif-unplugged-97b110e2-ceca-4ed9-8886-8d7d2149339f for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Acquiring lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:09 user nova-compute[72815]: DEBUG nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] No waiting events found dispatching network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:09 user nova-compute[72815]: WARNING nova.compute.manager [req-42a8963b-f88c-4efe-82cd-16dbfa5b0abf req-b013942e-e44a-4a80-b635-2e6247b378ac service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received unexpected event network-vif-plugged-97b110e2-ceca-4ed9-8886-8d7d2149339f for instance with vm_state active and task_state deleting.
Aug 17 20:07:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-85d2f810-40bb-4c3f-9ad9-458d56c805ca req-ccdd1c29-2b81-456e-9253-f5233c4ff513 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Received event network-changed-d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-85d2f810-40bb-4c3f-9ad9-458d56c805ca req-ccdd1c29-2b81-456e-9253-f5233c4ff513 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Refreshing instance network info cache due to event network-changed-d049d487-388c-408b-ada5-ae68e86585c3. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:07:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-85d2f810-40bb-4c3f-9ad9-458d56c805ca req-ccdd1c29-2b81-456e-9253-f5233c4ff513 service nova] Acquiring lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:07:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-85d2f810-40bb-4c3f-9ad9-458d56c805ca req-ccdd1c29-2b81-456e-9253-f5233c4ff513 service nova] Acquired lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:07:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-85d2f810-40bb-4c3f-9ad9-458d56c805ca req-ccdd1c29-2b81-456e-9253-f5233c4ff513 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Refreshing network info cache for port d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:07:10 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:10 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Took 2.04 seconds to deallocate network for instance.
Aug 17 20:07:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-d526ad56-5203-46a9-b19b-a1855148df7a req-29422bbd-3dd4-4791-82b7-8067b806e89e service nova] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Received event network-vif-deleted-97b110e2-ceca-4ed9-8886-8d7d2149339f {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-85d2f810-40bb-4c3f-9ad9-458d56c805ca req-ccdd1c29-2b81-456e-9253-f5233c4ff513 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updated VIF entry in instance network info cache for port d049d487-388c-408b-ada5-ae68e86585c3. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:07:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-85d2f810-40bb-4c3f-9ad9-458d56c805ca req-ccdd1c29-2b81-456e-9253-f5233c4ff513 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updating instance_info_cache with network_info: [{"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-85d2f810-40bb-4c3f-9ad9-458d56c805ca req-ccdd1c29-2b81-456e-9253-f5233c4ff513 service nova] Releasing lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:07:11 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:07:11 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:07:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.577s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:11 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Deleted allocations for instance fa0a87a2-9816-4aed-901d-1dff953f8046
Aug 17 20:07:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-96b898a8-8a93-49b9-9a69-78a277d86791 tempest-AttachVolumeTestJSON-1462912324 tempest-AttachVolumeTestJSON-1462912324-project-member] Lock "fa0a87a2-9816-4aed-901d-1dff953f8046" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.990s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Stashing vm_state: active {{(pid=72815) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 20:07:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-683c08b4-3011-44b4-9eca-09a5d96f57c6 req-b74951ec-7567-43c2-aa6b-79758bc58b57 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received event network-changed-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-683c08b4-3011-44b4-9eca-09a5d96f57c6 req-b74951ec-7567-43c2-aa6b-79758bc58b57 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Refreshing instance network info cache due to event network-changed-8eef4553-caa7-4c0f-93f3-bef2adb15e66. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:07:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-683c08b4-3011-44b4-9eca-09a5d96f57c6 req-b74951ec-7567-43c2-aa6b-79758bc58b57 service nova] Acquiring lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:07:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-683c08b4-3011-44b4-9eca-09a5d96f57c6 req-b74951ec-7567-43c2-aa6b-79758bc58b57 service nova] Acquired lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:07:12 user nova-compute[72815]: DEBUG nova.network.neutron [req-683c08b4-3011-44b4-9eca-09a5d96f57c6 req-b74951ec-7567-43c2-aa6b-79758bc58b57 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Refreshing network info cache for port 8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:07:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'pci_requests' on Instance uuid 4c630764-4e1b-4bab-b354-1389cd60f5a5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:12 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:07:12 user nova-compute[72815]: INFO nova.compute.claims [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Claim successful on node user
Aug 17 20:07:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'resources' on Instance uuid 4c630764-4e1b-4bab-b354-1389cd60f5a5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c630764-4e1b-4bab-b354-1389cd60f5a5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:12 user nova-compute[72815]: INFO nova.compute.resource_tracker [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updating resource usage from migration 65d0cdd3-5c78-4663-9138-7a4d52ef7045
Aug 17 20:07:13 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:07:13 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:07:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.571s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:13 user nova-compute[72815]: INFO nova.compute.manager [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Migrating
Aug 17 20:07:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:07:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-683c08b4-3011-44b4-9eca-09a5d96f57c6 req-b74951ec-7567-43c2-aa6b-79758bc58b57 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updated VIF entry in instance network info cache for port 8eef4553-caa7-4c0f-93f3-bef2adb15e66. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:07:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-683c08b4-3011-44b4-9eca-09a5d96f57c6 req-b74951ec-7567-43c2-aa6b-79758bc58b57 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updating instance_info_cache with network_info: [{"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-683c08b4-3011-44b4-9eca-09a5d96f57c6 req-b74951ec-7567-43c2-aa6b-79758bc58b57 service nova] Releasing lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:07:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquired lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:07:13 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:07:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:13 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updating instance_info_cache with network_info: [{"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Releasing lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Starting migrate_disk_and_power_off {{(pid=72815) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG nova.compute.manager [req-3335ae10-ee45-47f0-8b22-9b7a8791f663 req-349ed1c3-bf66-4ae6-b971-96f58ce85cd4 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received event network-vif-unplugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3335ae10-ee45-47f0-8b22-9b7a8791f663 req-349ed1c3-bf66-4ae6-b971-96f58ce85cd4 service nova] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3335ae10-ee45-47f0-8b22-9b7a8791f663 req-349ed1c3-bf66-4ae6-b971-96f58ce85cd4 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3335ae10-ee45-47f0-8b22-9b7a8791f663 req-349ed1c3-bf66-4ae6-b971-96f58ce85cd4 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG nova.compute.manager [req-3335ae10-ee45-47f0-8b22-9b7a8791f663 req-349ed1c3-bf66-4ae6-b971-96f58ce85cd4 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] No waiting events found dispatching network-vif-unplugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:14 user nova-compute[72815]: WARNING nova.compute.manager [req-3335ae10-ee45-47f0-8b22-9b7a8791f663 req-349ed1c3-bf66-4ae6-b971-96f58ce85cd4 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received unexpected event network-vif-unplugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 for instance with vm_state active and task_state resize_migrating.
Aug 17 20:07:14 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Instance destroyed successfully.
Aug 17 20:07:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-860044542',display_name='tempest-ServerActionsTestOtherA-server-860044542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-860044542',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4ENuaMW9sQVv3tRQvGXO2rdSecjVcsBbTS05/ZUuaQNEEpkOe2HF0EHrSzQ0+4hhL3IgPXmkF5ZxUJ6bIwwpVvvT5kiu8Xp5gaO6UacRTK/fZorahpTHXq4z54fcfMBQ==',key_name='tempest-keypair-1973140313',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-o2ttr69y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=4c630764-4e1b-4bab-b354-1389cd60f5a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1515676333-network", "vif_mac": "fa:16:3e:27:4e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1515676333-network", "vif_mac": "fa:16:3e:27:4e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG os_vif [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eef4553-ca, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:07:14 user nova-compute[72815]: INFO os_vif [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca')
Aug 17 20:07:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytbPpMxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:07:14 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:07:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efe6ad4-c1bb-4385-b03f-fa3ff9239307]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdf1549-a7fc-4193-83ad-e9ecf9c99b37]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:14 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:14 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:07:14 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:14 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:07:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:07:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:14 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:14 user nova-compute[72815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:07:14 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:14 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:07:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944a4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9'): ({'sdd'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Removing single pathed devices sdd {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43824dd-8383-4c79-a5df-e78179174dc8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa01eb2-6b30-452d-ad42-e70a3ce6f7a1]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flushing IO for device /dev/sdd {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30a7848-fe2e-47ba-bc9c-84422461125d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffeb95f-7cc5-4356-a5d5-42af92f8dd9a]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23165333239373766', '/dev/disk/by-id/scsi-1SCST_BIO36f7dc3d-1e32977f3b2a527f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_36f7dc3d') {{(pid=84269) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaea093-98e9-498c-9e92-3996a7f82094]: (4, None) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e92dda-ddeb-410b-af49-d699d463f06a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8def2d46-8680-4517-b335-27665aafd4b6]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260]
Aug 17 20:07:15 user nova-compute[72815]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260] successful.
Aug 17 20:07:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cd2382-b14f-4c13-b07c-0706c2393e2f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== disconnect_volume: return (349ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:07:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Port 8eef4553-caa7-4c0f-93f3-bef2adb15e66 binding to destination host user is already ACTIVE {{(pid=72815) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-2489c3cf-fbd0-43d1-bac4-e3612b2a544c req-259e0343-b22c-496b-a562-06abf3bc98dd service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received event network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2489c3cf-fbd0-43d1-bac4-e3612b2a544c req-259e0343-b22c-496b-a562-06abf3bc98dd service nova] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2489c3cf-fbd0-43d1-bac4-e3612b2a544c req-259e0343-b22c-496b-a562-06abf3bc98dd service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2489c3cf-fbd0-43d1-bac4-e3612b2a544c req-259e0343-b22c-496b-a562-06abf3bc98dd service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-2489c3cf-fbd0-43d1-bac4-e3612b2a544c req-259e0343-b22c-496b-a562-06abf3bc98dd service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] No waiting events found dispatching network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:16 user nova-compute[72815]: WARNING nova.compute.manager [req-2489c3cf-fbd0-43d1-bac4-e3612b2a544c req-259e0343-b22c-496b-a562-06abf3bc98dd service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received unexpected event network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 for instance with vm_state active and task_state resize_migrated.
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquired lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "1702dc0c-9333-4f16-937e-31beb1ea21fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:16 user nova-compute[72815]: INFO nova.compute.manager [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Terminating instance
Aug 17 20:07:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updating instance_info_cache with network_info: [{"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Releasing lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.utils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b957dbf8-a553-46f1-a2bb-06cf27df1744]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c927bc9-7ee2-4244-84b5-1bee9ffa764d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7607a4d3-8f3e-439f-acda-aafd45cc2dbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[398f18e7-5383-4ca7-bb91-7d3721846d52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:17 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Instance destroyed successfully.
Aug 17 20:07:17 user nova-compute[72815]: DEBUG nova.objects.instance [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lazy-loading 'resources' on Instance uuid 1702dc0c-9333-4f16-937e-31beb1ea21fe {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1062185546',display_name='tempest-TestVolumeBootPattern-server-1062185546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1062185546',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:05:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-yaix7ok0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:05:55Z,user_data=None,user_id='577ed0692a254a2fbd518e258563447f',uuid=1702dc0c-9333-4f16-937e-31beb1ea21fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53829955-ed05-4986-b1e9-9bad4ac89908", "address": "fa:16:3e:04:f9:75", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53829955-ed", "ovs_interfaceid": "53829955-ed05-4986-b1e9-9bad4ac89908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "53829955-ed05-4986-b1e9-9bad4ac89908", "address": "fa:16:3e:04:f9:75", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53829955-ed", "ovs_interfaceid": "53829955-ed05-4986-b1e9-9bad4ac89908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f9:75,bridge_name='br-int',has_traffic_filtering=True,id=53829955-ed05-4986-b1e9-9bad4ac89908,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53829955-ed') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_vif [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f9:75,bridge_name='br-int',has_traffic_filtering=True,id=53829955-ed05-4986-b1e9-9bad4ac89908,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53829955-ed') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:07:17 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e105980e-5650-46d0-8ec0-b94d34c7801b]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53829955-ed, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.utils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== get_connector_properties: return (269ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:07:17 user nova-compute[72815]: INFO os_vif [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f9:75,bridge_name='br-int',has_traffic_filtering=True,id=53829955-ed05-4986-b1e9-9bad4ac89908,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53829955-ed')
Aug 17 20:07:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVfykuEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:07:17 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e4bb9-afe3-4761-808b-86dfaa0b0f9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[44af5c21-d7ee-484e-8582-ed300c35f4d7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:17 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:17 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:17 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:07:17 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:17 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:17 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:17 user nova-compute[72815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 (non-flash)
Aug 17 20:07:17 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399444cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25'): ({'sdf'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Removing single pathed devices sdf {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:07:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d25011-0193-4498-8f6d-ec3e87b18a31]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c08edb-ad43-4ca0-ba0e-a5beca2cdcdd]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flushing IO for device /dev/sdf {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d689470b-04d7-440c-9167-eaccd50e0a2c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.069s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfde9e18-defb-4dbf-8240-7aab74f326e5]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d794a91-85a8-4378-922e-d89a091fb38f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c894f9d-76b3-4621-b10c-37b30a5b76e3]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25, portal: 172.16.0.220,3260]
Aug 17 20:07:18 user nova-compute[72815]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25, portal: 172.16.0.220,3260] successful.
Aug 17 20:07:18 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8af8963-9af0-4e7e-be96-cb1b5313fb25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e31d1d-b88a-4e25-8fce-0cac53b5a9bf]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== disconnect_volume: return (393ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:07:18 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Deleting instance files /opt/stack/data/nova/instances/1702dc0c-9333-4f16-937e-31beb1ea21fe_del
Aug 17 20:07:18 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Deletion of /opt/stack/data/nova/instances/1702dc0c-9333-4f16-937e-31beb1ea21fe_del complete
Aug 17 20:07:18 user nova-compute[72815]: INFO nova.compute.manager [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received event network-vif-unplugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Acquiring lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] No waiting events found dispatching network-vif-unplugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received event network-vif-unplugged-53829955-ed05-4986-b1e9-9bad4ac89908 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received event network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Acquiring lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] No waiting events found dispatching network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:18 user nova-compute[72815]: WARNING nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received unexpected event network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 for instance with vm_state active and task_state deleting.
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received event network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Acquiring lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] No waiting events found dispatching network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:18 user nova-compute[72815]: WARNING nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received unexpected event network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 for instance with vm_state active and task_state deleting.
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received event network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Acquiring lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] No waiting events found dispatching network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:18 user nova-compute[72815]: WARNING nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received unexpected event network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 for instance with vm_state active and task_state deleting.
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received event network-vif-unplugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Acquiring lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] No waiting events found dispatching network-vif-unplugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e4829e6-0d73-4168-90a4-db8a585c9321 req-e813c6e6-3814-4000-97bb-aabff30800c0 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received event network-vif-unplugged-53829955-ed05-4986-b1e9-9bad4ac89908 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:07:19 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:19 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Took 1.32 seconds to deallocate network for instance.
Aug 17 20:07:20 user nova-compute[72815]: INFO nova.compute.manager [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Took 0.89 seconds to detach 1 volumes for instance.
Aug 17 20:07:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Deleting volume: b8af8963-9af0-4e7e-be96-cb1b5313fb25 {{(pid=72815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 20:07:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-17e4d7cb-768d-4399-927b-6f58a418a32e req-5c323cb8-9269-4084-8d5c-9a4be2e6a829 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received event network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-17e4d7cb-768d-4399-927b-6f58a418a32e req-5c323cb8-9269-4084-8d5c-9a4be2e6a829 service nova] Acquiring lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-17e4d7cb-768d-4399-927b-6f58a418a32e req-5c323cb8-9269-4084-8d5c-9a4be2e6a829 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-17e4d7cb-768d-4399-927b-6f58a418a32e req-5c323cb8-9269-4084-8d5c-9a4be2e6a829 service nova] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-17e4d7cb-768d-4399-927b-6f58a418a32e req-5c323cb8-9269-4084-8d5c-9a4be2e6a829 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] No waiting events found dispatching network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:20 user nova-compute[72815]: WARNING nova.compute.manager [req-17e4d7cb-768d-4399-927b-6f58a418a32e req-5c323cb8-9269-4084-8d5c-9a4be2e6a829 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received unexpected event network-vif-plugged-53829955-ed05-4986-b1e9-9bad4ac89908 for instance with vm_state deleted and task_state None.
Aug 17 20:07:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-17e4d7cb-768d-4399-927b-6f58a418a32e req-5c323cb8-9269-4084-8d5c-9a4be2e6a829 service nova] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Received event network-vif-deleted-53829955-ed05-4986-b1e9-9bad4ac89908 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:21 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:07:21 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:07:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:21 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Deleted allocations for instance 1702dc0c-9333-4f16-937e-31beb1ea21fe
Aug 17 20:07:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-342817c1-d0c9-4f33-b06c-2d6e723b4cc6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "1702dc0c-9333-4f16-937e-31beb1ea21fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.467s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:23 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302828.3357184, fa0a87a2-9816-4aed-901d-1dff953f8046 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:07:23 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] VM Stopped (Lifecycle Event)
Aug 17 20:07:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-db6f7731-e1c8-42a3-acc6-de4f6b88c85a None None] [instance: fa0a87a2-9816-4aed-901d-1dff953f8046] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:29 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302834.900452, 4c630764-4e1b-4bab-b354-1389cd60f5a5 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:07:29 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] VM Stopped (Lifecycle Event)
Aug 17 20:07:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-717fad60-f2e6-47d0-b3cb-e84d4b364146 None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-717fad60-f2e6-47d0-b3cb-e84d4b364146 None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:07:29 user nova-compute[72815]: INFO nova.compute.manager [None req-717fad60-f2e6-47d0-b3cb-e84d4b364146 None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 20:07:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Starting finish_migration {{(pid=72815) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Instance directory exists: not creating {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 20:07:30 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Creating image(s)
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Ensure instance console log exists: /opt/stack/data/nova/instances/4c630764-4e1b-4bab-b354-1389cd60f5a5/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Start _get_guest_xml network_info=[{"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1515676333-network", "vif_mac": "fa:16:3e:27:4e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': 'e8abd884-6d9b-44b0-ad58-78a310b7374a', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytbPpMxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4c630764-4e1b-4bab-b354-1389cd60f5a5', 'attached_at': '2023-08-17T20:07:30.000000', 'detached_at': '', 'volume_id': '228e179c-97dd-4ee6-978b-4450933aa2c9', 'serial': '228e179c-97dd-4ee6-978b-4450933aa2c9'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:07:30 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:07:30 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4c630764-4e1b-4bab-b354-1389cd60f5a5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytbPpMxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:07:30 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:07:30 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:07:30 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3e8ac6-a0e6-4a92-a755-05108886bbc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:07:30 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccc4ea0-7060-4785-867b-aa0ae2b7c49b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9] added
Aug 17 20:07:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a9fcae-f315-46ab-a233-9486e883a4ea]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92f9295-255f-4bd3-aa63-ad8235d2a9ea]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytbPpMxJ {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytbPpMxJ" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6947cb84-da23-401f-9180-ec3abf52ce49]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ytbPpMxJ'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e667a4-1843-4e46-9b76-92c2c58ca2b8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[890df194-0fc1-4fbf-be14-d8475bb18f53]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:30 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:30 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:30 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:30 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c51c5e-77cb-4eea-a43e-97e9131ff5b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260]
Aug 17 20:07:30 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260] successful.
Aug 17 20:07:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[820f859c-a179-4e2d-8a25-9f68aac0f3c3]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11ea170-611f-4d56-b365-f633d6a41a82]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:30 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:30 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:30 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:07:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:07:30 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:07:30 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:07:30 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:07:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[712d6ce3-61ec-48b2-9333-1dde78e77f4c]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:30 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytbPpMxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23165333239373766', 'path': '/dev/sdd'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165333239373766', 'path': '/dev/sdd'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-860044542',display_name='tempest-ServerActionsTestOtherA-server-860044542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-860044542',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4ENuaMW9sQVv3tRQvGXO2rdSecjVcsBbTS05/ZUuaQNEEpkOe2HF0EHrSzQ0+4hhL3IgPXmkF5ZxUJ6bIwwpVvvT5kiu8Xp5gaO6UacRTK/fZorahpTHXq4z54fcfMBQ==',key_name='tempest-keypair-1973140313',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-o2ttr69y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=4c630764-4e1b-4bab-b354-1389cd60f5a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1515676333-network", "vif_mac": "fa:16:3e:27:4e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1515676333-network", "vif_mac": "fa:16:3e:27:4e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:07:31 user nova-compute[72815]:   <uuid>4c630764-4e1b-4bab-b354-1389cd60f5a5</uuid>
Aug 17 20:07:31 user nova-compute[72815]:   <name>instance-0000001c</name>
Aug 17 20:07:31 user nova-compute[72815]:   <memory>2097152</memory>
Aug 17 20:07:31 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:07:31 user nova-compute[72815]:   <metadata>
Aug 17 20:07:31 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:07:31 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:07:31 user nova-compute[72815]:       <nova:name>tempest-ServerActionsTestOtherA-server-860044542</nova:name>
Aug 17 20:07:31 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:07:30</nova:creationTime>
Aug 17 20:07:31 user nova-compute[72815]:       <nova:flavor name="m1.small">
Aug 17 20:07:31 user nova-compute[72815]:         <nova:memory>2048</nova:memory>
Aug 17 20:07:31 user nova-compute[72815]:         <nova:disk>20</nova:disk>
Aug 17 20:07:31 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:07:31 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:07:31 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:07:31 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:07:31 user nova-compute[72815]:       <nova:owner>
Aug 17 20:07:31 user nova-compute[72815]:         <nova:user uuid="9821282c73174c448f7fca6b65676f61">tempest-ServerActionsTestOtherA-629489909-project-member</nova:user>
Aug 17 20:07:31 user nova-compute[72815]:         <nova:project uuid="a0708d4f49ed4c96b108d1d2aff76871">tempest-ServerActionsTestOtherA-629489909</nova:project>
Aug 17 20:07:31 user nova-compute[72815]:       </nova:owner>
Aug 17 20:07:31 user nova-compute[72815]:       <nova:ports>
Aug 17 20:07:31 user nova-compute[72815]:         <nova:port uuid="8eef4553-caa7-4c0f-93f3-bef2adb15e66">
Aug 17 20:07:31 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 20:07:31 user nova-compute[72815]:         </nova:port>
Aug 17 20:07:31 user nova-compute[72815]:       </nova:ports>
Aug 17 20:07:31 user nova-compute[72815]:     </nova:instance>
Aug 17 20:07:31 user nova-compute[72815]:   </metadata>
Aug 17 20:07:31 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:07:31 user nova-compute[72815]:     <system>
Aug 17 20:07:31 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:07:31 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:07:31 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:07:31 user nova-compute[72815]:       <entry name="serial">4c630764-4e1b-4bab-b354-1389cd60f5a5</entry>
Aug 17 20:07:31 user nova-compute[72815]:       <entry name="uuid">4c630764-4e1b-4bab-b354-1389cd60f5a5</entry>
Aug 17 20:07:31 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:07:31 user nova-compute[72815]:     </system>
Aug 17 20:07:31 user nova-compute[72815]:   </sysinfo>
Aug 17 20:07:31 user nova-compute[72815]:   <os>
Aug 17 20:07:31 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:07:31 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:07:31 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:07:31 user nova-compute[72815]:   </os>
Aug 17 20:07:31 user nova-compute[72815]:   <features>
Aug 17 20:07:31 user nova-compute[72815]:     <acpi/>
Aug 17 20:07:31 user nova-compute[72815]:     <apic/>
Aug 17 20:07:31 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:07:31 user nova-compute[72815]:   </features>
Aug 17 20:07:31 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:07:31 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:07:31 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:07:31 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:07:31 user nova-compute[72815]:   </clock>
Aug 17 20:07:31 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:07:31 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:07:31 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:07:31 user nova-compute[72815]:   </cpu>
Aug 17 20:07:31 user nova-compute[72815]:   <devices>
Aug 17 20:07:31 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:07:31 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:07:31 user nova-compute[72815]:       <source dev="/dev/sdd"/>
Aug 17 20:07:31 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:07:31 user nova-compute[72815]:       <serial>228e179c-97dd-4ee6-978b-4450933aa2c9</serial>
Aug 17 20:07:31 user nova-compute[72815]:     </disk>
Aug 17 20:07:31 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:07:31 user nova-compute[72815]:       <mac address="fa:16:3e:27:4e:31"/>
Aug 17 20:07:31 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:07:31 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:07:31 user nova-compute[72815]:       <target dev="tap8eef4553-ca"/>
Aug 17 20:07:31 user nova-compute[72815]:     </interface>
Aug 17 20:07:31 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:07:31 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/4c630764-4e1b-4bab-b354-1389cd60f5a5/console.log" append="off"/>
Aug 17 20:07:31 user nova-compute[72815]:     </serial>
Aug 17 20:07:31 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:07:31 user nova-compute[72815]:     <video>
Aug 17 20:07:31 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:07:31 user nova-compute[72815]:     </video>
Aug 17 20:07:31 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:07:31 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:07:31 user nova-compute[72815]:     </rng>
Aug 17 20:07:31 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:07:31 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:07:31 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:07:31 user nova-compute[72815]:     </memballoon>
Aug 17 20:07:31 user nova-compute[72815]:   </devices>
Aug 17 20:07:31 user nova-compute[72815]: </domain>
Aug 17 20:07:31 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-860044542',display_name='tempest-ServerActionsTestOtherA-server-860044542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-860044542',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4ENuaMW9sQVv3tRQvGXO2rdSecjVcsBbTS05/ZUuaQNEEpkOe2HF0EHrSzQ0+4hhL3IgPXmkF5ZxUJ6bIwwpVvvT5kiu8Xp5gaO6UacRTK/fZorahpTHXq4z54fcfMBQ==',key_name='tempest-keypair-1973140313',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-o2ttr69y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=4c630764-4e1b-4bab-b354-1389cd60f5a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1515676333-network", "vif_mac": "fa:16:3e:27:4e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1515676333-network", "vif_mac": "fa:16:3e:27:4e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG os_vif [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eef4553-ca, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8eef4553-ca, col_values=(('external_ids', {'iface-id': '8eef4553-caa7-4c0f-93f3-bef2adb15e66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:4e:31', 'vm-uuid': '4c630764-4e1b-4bab-b354-1389cd60f5a5'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:31 user nova-compute[72815]: INFO os_vif [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca')
Aug 17 20:07:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:07:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] No VIF found with MAC fa:16:3e:27:4e:31, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:07:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:07:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:32 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302837.702302, 1702dc0c-9333-4f16-937e-31beb1ea21fe => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:07:32 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] VM Stopped (Lifecycle Event)
Aug 17 20:07:32 user nova-compute[72815]: DEBUG nova.compute.manager [None req-267f70e0-4983-4d96-a2db-b62308c3d02f None None] [instance: 1702dc0c-9333-4f16-937e-31beb1ea21fe] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-e6ac3cdd-888f-4a01-90e3-faf0e6940001 req-ff79c13b-9e4c-4561-85db-0fc8dcacdb85 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received event network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e6ac3cdd-888f-4a01-90e3-faf0e6940001 req-ff79c13b-9e4c-4561-85db-0fc8dcacdb85 service nova] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e6ac3cdd-888f-4a01-90e3-faf0e6940001 req-ff79c13b-9e4c-4561-85db-0fc8dcacdb85 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e6ac3cdd-888f-4a01-90e3-faf0e6940001 req-ff79c13b-9e4c-4561-85db-0fc8dcacdb85 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-e6ac3cdd-888f-4a01-90e3-faf0e6940001 req-ff79c13b-9e4c-4561-85db-0fc8dcacdb85 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] No waiting events found dispatching network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:33 user nova-compute[72815]: WARNING nova.compute.manager [req-e6ac3cdd-888f-4a01-90e3-faf0e6940001 req-ff79c13b-9e4c-4561-85db-0fc8dcacdb85 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received unexpected event network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 for instance with vm_state active and task_state resize_finish.
Aug 17 20:07:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302855.507977, 4c630764-4e1b-4bab-b354-1389cd60f5a5 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:07:35 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] VM Resumed (Lifecycle Event)
Aug 17 20:07:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:07:35 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Instance running successfully.
Aug 17 20:07:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Failed to set time: agent not configured {{(pid=72815) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf6b7696-a04d-4672-a512-4584a5813765 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] finish_migration finished successfully. {{(pid=72815) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:07:35 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 20:07:35 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302855.512155, 4c630764-4e1b-4bab-b354-1389cd60f5a5 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:07:35 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] VM Started (Lifecycle Event)
Aug 17 20:07:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:07:35 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 20:07:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-1eba95d0-a209-42e9-9b8c-cab234191902 req-252353cc-1349-43e9-8b5c-4626b5d55ed0 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received event network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1eba95d0-a209-42e9-9b8c-cab234191902 req-252353cc-1349-43e9-8b5c-4626b5d55ed0 service nova] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1eba95d0-a209-42e9-9b8c-cab234191902 req-252353cc-1349-43e9-8b5c-4626b5d55ed0 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1eba95d0-a209-42e9-9b8c-cab234191902 req-252353cc-1349-43e9-8b5c-4626b5d55ed0 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:35 user nova-compute[72815]: DEBUG nova.compute.manager [req-1eba95d0-a209-42e9-9b8c-cab234191902 req-252353cc-1349-43e9-8b5c-4626b5d55ed0 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] No waiting events found dispatching network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:35 user nova-compute[72815]: WARNING nova.compute.manager [req-1eba95d0-a209-42e9-9b8c-cab234191902 req-252353cc-1349-43e9-8b5c-4626b5d55ed0 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received unexpected event network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 for instance with vm_state active and task_state resize_finish.
Aug 17 20:07:36 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:07:36 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7054MB free_disk=25.23328399658203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Applying migration context for instance 4c630764-4e1b-4bab-b354-1389cd60f5a5 as it has an incoming, in-progress migration 65d0cdd3-5c78-4663-9138-7a4d52ef7045. Migration status is finished {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 20:07:36 user nova-compute[72815]: INFO nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updating resource usage from migration 65d0cdd3-5c78-4663-9138-7a4d52ef7045
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 12a34846-1670-4c6c-ac7d-522530aaf3a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 72c9428f-f797-46b4-9780-d2a4abb01ae7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance caffa446-5b29-4c5d-b756-4cc7119676cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 634e7522-f51c-4556-827f-18ec5fee230a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 8ac64ac9-a49d-4c70-956b-3a140da5ede8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Migration 65d0cdd3-5c78-4663-9138-7a4d52ef7045 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 4c630764-4e1b-4bab-b354-1389cd60f5a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:07:36 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.763s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "634e7522-f51c-4556-827f-18ec5fee230a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "634e7522-f51c-4556-827f-18ec5fee230a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "634e7522-f51c-4556-827f-18ec5fee230a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "634e7522-f51c-4556-827f-18ec5fee230a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "634e7522-f51c-4556-827f-18ec5fee230a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:37 user nova-compute[72815]: INFO nova.compute.manager [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Terminating instance
Aug 17 20:07:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG nova.compute.manager [req-70dd31cb-3d87-4f88-9556-6216b296818a req-5bf88e48-16fc-45a8-94c7-59afedc8e5b9 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Received event network-changed-6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG nova.compute.manager [req-70dd31cb-3d87-4f88-9556-6216b296818a req-5bf88e48-16fc-45a8-94c7-59afedc8e5b9 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Refreshing instance network info cache due to event network-changed-6629ee00-d584-48cd-8e48-3567e19b2f5e. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-70dd31cb-3d87-4f88-9556-6216b296818a req-5bf88e48-16fc-45a8-94c7-59afedc8e5b9 service nova] Acquiring lock "refresh_cache-634e7522-f51c-4556-827f-18ec5fee230a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-70dd31cb-3d87-4f88-9556-6216b296818a req-5bf88e48-16fc-45a8-94c7-59afedc8e5b9 service nova] Acquired lock "refresh_cache-634e7522-f51c-4556-827f-18ec5fee230a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG nova.network.neutron [req-70dd31cb-3d87-4f88-9556-6216b296818a req-5bf88e48-16fc-45a8-94c7-59afedc8e5b9 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Refreshing network info cache for port 6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.network.neutron [req-70dd31cb-3d87-4f88-9556-6216b296818a req-5bf88e48-16fc-45a8-94c7-59afedc8e5b9 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Updated VIF entry in instance network info cache for port 6629ee00-d584-48cd-8e48-3567e19b2f5e. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.network.neutron [req-70dd31cb-3d87-4f88-9556-6216b296818a req-5bf88e48-16fc-45a8-94c7-59afedc8e5b9 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Updating instance_info_cache with network_info: [{"id": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "address": "fa:16:3e:82:f3:fc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6629ee00-d5", "ovs_interfaceid": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-70dd31cb-3d87-4f88-9556-6216b296818a req-5bf88e48-16fc-45a8-94c7-59afedc8e5b9 service nova] Releasing lock "refresh_cache-634e7522-f51c-4556-827f-18ec5fee230a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:07:38 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Instance destroyed successfully.
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.objects.instance [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'resources' on Instance uuid 634e7522-f51c-4556-827f-18ec5fee230a {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1454126474',display_name='tempest-AttachVolumeNegativeTest-server-1454126474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1454126474',id=30,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiizNFVflfOsNb1xLlY8D6pbqz9zUc3IoLR5az0gWMgn4ARFnyVMel8um8b99aBN9MpGzfFwAqakb8ty/Z470ZEMP68LsQjQXcpCq+sm2XH5DB4bcNxp+gfHE8eLtJipA==',key_name='tempest-keypair-184602591',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:05:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ee9b4cae7404f3184fc480ffddfbbcd',ramdisk_id='',reservation_id='r-xwcnfexg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1950293532',owner_user_name='tempest-AttachVolumeNegativeTest-1950293532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:05:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a75e05392d54cfb9fcda786e3ee2efc',uuid=634e7522-f51c-4556-827f-18ec5fee230a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "address": "fa:16:3e:82:f3:fc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6629ee00-d5", "ovs_interfaceid": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converting VIF {"id": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "address": "fa:16:3e:82:f3:fc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6629ee00-d5", "ovs_interfaceid": "6629ee00-d584-48cd-8e48-3567e19b2f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:f3:fc,bridge_name='br-int',has_traffic_filtering=True,id=6629ee00-d584-48cd-8e48-3567e19b2f5e,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6629ee00-d5') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG os_vif [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f3:fc,bridge_name='br-int',has_traffic_filtering=True,id=6629ee00-d584-48cd-8e48-3567e19b2f5e,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6629ee00-d5') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6629ee00-d5, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:07:38 user nova-compute[72815]: INFO os_vif [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f3:fc,bridge_name='br-int',has_traffic_filtering=True,id=6629ee00-d584-48cd-8e48-3567e19b2f5e,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6629ee00-d5')
Aug 17 20:07:38 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Deleting instance files /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a_del
Aug 17 20:07:38 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Deletion of /opt/stack/data/nova/instances/634e7522-f51c-4556-827f-18ec5fee230a_del complete
Aug 17 20:07:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Acquiring lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:38 user nova-compute[72815]: INFO nova.compute.manager [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 20:07:38 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-3e9c0718-94d7-4e86-9386-0e08891b3197 req-f7b5b895-cd90-4109-a0d0-8a917b4c3ab4 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Received event network-vif-unplugged-6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3e9c0718-94d7-4e86-9386-0e08891b3197 req-f7b5b895-cd90-4109-a0d0-8a917b4c3ab4 service nova] Acquiring lock "634e7522-f51c-4556-827f-18ec5fee230a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3e9c0718-94d7-4e86-9386-0e08891b3197 req-f7b5b895-cd90-4109-a0d0-8a917b4c3ab4 service nova] Lock "634e7522-f51c-4556-827f-18ec5fee230a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3e9c0718-94d7-4e86-9386-0e08891b3197 req-f7b5b895-cd90-4109-a0d0-8a917b4c3ab4 service nova] Lock "634e7522-f51c-4556-827f-18ec5fee230a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-3e9c0718-94d7-4e86-9386-0e08891b3197 req-f7b5b895-cd90-4109-a0d0-8a917b4c3ab4 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] No waiting events found dispatching network-vif-unplugged-6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-3e9c0718-94d7-4e86-9386-0e08891b3197 req-f7b5b895-cd90-4109-a0d0-8a917b4c3ab4 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Received event network-vif-unplugged-6629ee00-d584-48cd-8e48-3567e19b2f5e for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:38 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:07:38 user nova-compute[72815]: INFO nova.compute.claims [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Claim successful on node user
Aug 17 20:07:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG nova.compute.manager [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.529s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:07:39 user nova-compute[72815]: INFO nova.compute.claims [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Claim successful on node user
Aug 17 20:07:39 user nova-compute[72815]: DEBUG nova.compute.manager [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG nova.network.neutron [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:07:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:07:39 user nova-compute[72815]: DEBUG nova.compute.manager [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG nova.policy [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd64919c88ba4427caa388105aaf0c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba22a2e532a42f9bf4d23a301a99af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG nova.compute.manager [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:07:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Creating image(s)
Aug 17 20:07:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Acquiring lock "/opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "/opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "/opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:39 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Took 1.11 seconds to deallocate network for instance.
Aug 17 20:07:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-c6a7866f-b5d3-4424-9bbc-70d56af191f9 req-63560cc0-bd6f-46c8-9364-c29955147e5a service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Received event network-vif-deleted-6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.231s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.240s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.209s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk 1073741824" returned: 0 in 0.056s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:07:40 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.policy [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75682a0e782445619cbbb7781d3e37a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4773a7956484abfbcd86cc1a89c8dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.217s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.network.neutron [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Successfully created port: 16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:07:40 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Creating image(s)
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "/opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "/opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "/opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Cannot resize image /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.objects.instance [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lazy-loading 'migration_context' on Instance uuid 3640f710-270a-48d4-9ae6-ffe7780d5bc8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Ensure instance console log exists: /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-d386a69a-3392-4655-8281-7e44c67ae613 req-c15ba835-3b76-4de6-ae3f-3a0dcc187a40 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Received event network-vif-plugged-6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d386a69a-3392-4655-8281-7e44c67ae613 req-c15ba835-3b76-4de6-ae3f-3a0dcc187a40 service nova] Acquiring lock "634e7522-f51c-4556-827f-18ec5fee230a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d386a69a-3392-4655-8281-7e44c67ae613 req-c15ba835-3b76-4de6-ae3f-3a0dcc187a40 service nova] Lock "634e7522-f51c-4556-827f-18ec5fee230a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d386a69a-3392-4655-8281-7e44c67ae613 req-c15ba835-3b76-4de6-ae3f-3a0dcc187a40 service nova] Lock "634e7522-f51c-4556-827f-18ec5fee230a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-d386a69a-3392-4655-8281-7e44c67ae613 req-c15ba835-3b76-4de6-ae3f-3a0dcc187a40 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] No waiting events found dispatching network-vif-plugged-6629ee00-d584-48cd-8e48-3567e19b2f5e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:40 user nova-compute[72815]: WARNING nova.compute.manager [req-d386a69a-3392-4655-8281-7e44c67ae613 req-c15ba835-3b76-4de6-ae3f-3a0dcc187a40 service nova] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Received unexpected event network-vif-plugged-6629ee00-d584-48cd-8e48-3567e19b2f5e for instance with vm_state deleted and task_state None.
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.216s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:07:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.802s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:40 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Deleted allocations for instance 634e7522-f51c-4556-827f-18ec5fee230a
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.212s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b28d4eb0-f74d-405d-bede-d19ebdced091 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "634e7522-f51c-4556-827f-18ec5fee230a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.356s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk 1073741824" returned: 0 in 0.058s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Successfully created port: 1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.205s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Successfully updated port: 16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Acquiring lock "refresh_cache-3640f710-270a-48d4-9ae6-ffe7780d5bc8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Acquired lock "refresh_cache-3640f710-270a-48d4-9ae6-ffe7780d5bc8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-150406ff-b720-4ed7-b398-bf45e7251e70 req-06a6e2d0-8b5a-451d-ad56-8c1c2e2bce80 service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Received event network-changed-16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-150406ff-b720-4ed7-b398-bf45e7251e70 req-06a6e2d0-8b5a-451d-ad56-8c1c2e2bce80 service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Refreshing instance network info cache due to event network-changed-16a8d1d7-b13a-4e80-906a-89a504b2e10a. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-150406ff-b720-4ed7-b398-bf45e7251e70 req-06a6e2d0-8b5a-451d-ad56-8c1c2e2bce80 service nova] Acquiring lock "refresh_cache-3640f710-270a-48d4-9ae6-ffe7780d5bc8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Cannot resize image /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'migration_context' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Ensure instance console log exists: /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Updating instance_info_cache with network_info: [{"id": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "address": "fa:16:3e:77:df:e3", "network": {"id": "0d489fdb-4617-407d-8181-205ba807ec6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a9954624a59348f3ab4e9691dd6f1b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d1d7-b1", "ovs_interfaceid": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Releasing lock "refresh_cache-3640f710-270a-48d4-9ae6-ffe7780d5bc8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Instance network_info: |[{"id": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "address": "fa:16:3e:77:df:e3", "network": {"id": "0d489fdb-4617-407d-8181-205ba807ec6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a9954624a59348f3ab4e9691dd6f1b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d1d7-b1", "ovs_interfaceid": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-150406ff-b720-4ed7-b398-bf45e7251e70 req-06a6e2d0-8b5a-451d-ad56-8c1c2e2bce80 service nova] Acquired lock "refresh_cache-3640f710-270a-48d4-9ae6-ffe7780d5bc8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.network.neutron [req-150406ff-b720-4ed7-b398-bf45e7251e70 req-06a6e2d0-8b5a-451d-ad56-8c1c2e2bce80 service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Refreshing network info cache for port 16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Start _get_guest_xml network_info=[{"id": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "address": "fa:16:3e:77:df:e3", "network": {"id": "0d489fdb-4617-407d-8181-205ba807ec6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a9954624a59348f3ab4e9691dd6f1b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d1d7-b1", "ovs_interfaceid": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:41 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:07:41 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1338658228',display_name='tempest-VolumesNegativeTest-instance-1338658228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1338658228',id=33,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aba22a2e532a42f9bf4d23a301a99af0',ramdisk_id='',reservation_id='r-hdpayyk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-838376008',owner_user_name='tempest-VolumesNegativeTest-838376008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:07:40Z,user_data=None,user_id='d64919c88ba4427caa388105aaf0c68a',uuid=3640f710-270a-48d4-9ae6-ffe7780d5bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "address": "fa:16:3e:77:df:e3", "network": {"id": "0d489fdb-4617-407d-8181-205ba807ec6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a9954624a59348f3ab4e9691dd6f1b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d1d7-b1", "ovs_interfaceid": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Converting VIF {"id": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "address": "fa:16:3e:77:df:e3", "network": {"id": "0d489fdb-4617-407d-8181-205ba807ec6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a9954624a59348f3ab4e9691dd6f1b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d1d7-b1", "ovs_interfaceid": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:df:e3,bridge_name='br-int',has_traffic_filtering=True,id=16a8d1d7-b13a-4e80-906a-89a504b2e10a,network=Network(0d489fdb-4617-407d-8181-205ba807ec6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d1d7-b1') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lazy-loading 'pci_devices' on Instance uuid 3640f710-270a-48d4-9ae6-ffe7780d5bc8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:07:41 user nova-compute[72815]:   <uuid>3640f710-270a-48d4-9ae6-ffe7780d5bc8</uuid>
Aug 17 20:07:41 user nova-compute[72815]:   <name>instance-00000021</name>
Aug 17 20:07:41 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:07:41 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:07:41 user nova-compute[72815]:   <metadata>
Aug 17 20:07:41 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:07:41 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:07:41 user nova-compute[72815]:       <nova:name>tempest-VolumesNegativeTest-instance-1338658228</nova:name>
Aug 17 20:07:41 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:07:41</nova:creationTime>
Aug 17 20:07:41 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:07:41 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:07:41 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:07:41 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:07:41 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:07:41 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:07:41 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:07:41 user nova-compute[72815]:       <nova:owner>
Aug 17 20:07:41 user nova-compute[72815]:         <nova:user uuid="d64919c88ba4427caa388105aaf0c68a">tempest-VolumesNegativeTest-838376008-project-member</nova:user>
Aug 17 20:07:41 user nova-compute[72815]:         <nova:project uuid="aba22a2e532a42f9bf4d23a301a99af0">tempest-VolumesNegativeTest-838376008</nova:project>
Aug 17 20:07:41 user nova-compute[72815]:       </nova:owner>
Aug 17 20:07:41 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:07:41 user nova-compute[72815]:       <nova:ports>
Aug 17 20:07:41 user nova-compute[72815]:         <nova:port uuid="16a8d1d7-b13a-4e80-906a-89a504b2e10a">
Aug 17 20:07:41 user nova-compute[72815]:           <nova:ip type="fixed" address="192.168.233.146" ipVersion="4"/>
Aug 17 20:07:41 user nova-compute[72815]:         </nova:port>
Aug 17 20:07:41 user nova-compute[72815]:       </nova:ports>
Aug 17 20:07:41 user nova-compute[72815]:     </nova:instance>
Aug 17 20:07:41 user nova-compute[72815]:   </metadata>
Aug 17 20:07:41 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:07:41 user nova-compute[72815]:     <system>
Aug 17 20:07:41 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:07:41 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:07:41 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:07:41 user nova-compute[72815]:       <entry name="serial">3640f710-270a-48d4-9ae6-ffe7780d5bc8</entry>
Aug 17 20:07:41 user nova-compute[72815]:       <entry name="uuid">3640f710-270a-48d4-9ae6-ffe7780d5bc8</entry>
Aug 17 20:07:41 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:07:41 user nova-compute[72815]:     </system>
Aug 17 20:07:41 user nova-compute[72815]:   </sysinfo>
Aug 17 20:07:41 user nova-compute[72815]:   <os>
Aug 17 20:07:41 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:07:41 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:07:41 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:07:41 user nova-compute[72815]:   </os>
Aug 17 20:07:41 user nova-compute[72815]:   <features>
Aug 17 20:07:41 user nova-compute[72815]:     <acpi/>
Aug 17 20:07:41 user nova-compute[72815]:     <apic/>
Aug 17 20:07:41 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:07:41 user nova-compute[72815]:   </features>
Aug 17 20:07:41 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:07:41 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:07:41 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:07:41 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:07:41 user nova-compute[72815]:   </clock>
Aug 17 20:07:41 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:07:41 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:07:41 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:07:41 user nova-compute[72815]:   </cpu>
Aug 17 20:07:41 user nova-compute[72815]:   <devices>
Aug 17 20:07:41 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:07:41 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:07:41 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk"/>
Aug 17 20:07:41 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:07:41 user nova-compute[72815]:     </disk>
Aug 17 20:07:41 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:07:41 user nova-compute[72815]:       <mac address="fa:16:3e:77:df:e3"/>
Aug 17 20:07:41 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:07:41 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:07:41 user nova-compute[72815]:       <target dev="tap16a8d1d7-b1"/>
Aug 17 20:07:41 user nova-compute[72815]:     </interface>
Aug 17 20:07:41 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:07:41 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/console.log" append="off"/>
Aug 17 20:07:41 user nova-compute[72815]:     </serial>
Aug 17 20:07:41 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:07:41 user nova-compute[72815]:     <video>
Aug 17 20:07:41 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:07:41 user nova-compute[72815]:     </video>
Aug 17 20:07:41 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:07:41 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:07:41 user nova-compute[72815]:     </rng>
Aug 17 20:07:41 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:07:41 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:07:41 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:07:41 user nova-compute[72815]:     </memballoon>
Aug 17 20:07:41 user nova-compute[72815]:   </devices>
Aug 17 20:07:41 user nova-compute[72815]: </domain>
Aug 17 20:07:41 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1338658228',display_name='tempest-VolumesNegativeTest-instance-1338658228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1338658228',id=33,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aba22a2e532a42f9bf4d23a301a99af0',ramdisk_id='',reservation_id='r-hdpayyk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-838376008',owner_user_name='tempest-VolumesNegativeTest-838376008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:07:40Z,user_data=None,user_id='d64919c88ba4427caa388105aaf0c68a',uuid=3640f710-270a-48d4-9ae6-ffe7780d5bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "address": "fa:16:3e:77:df:e3", "network": {"id": "0d489fdb-4617-407d-8181-205ba807ec6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a9954624a59348f3ab4e9691dd6f1b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d1d7-b1", "ovs_interfaceid": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Converting VIF {"id": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "address": "fa:16:3e:77:df:e3", "network": {"id": "0d489fdb-4617-407d-8181-205ba807ec6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a9954624a59348f3ab4e9691dd6f1b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d1d7-b1", "ovs_interfaceid": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:df:e3,bridge_name='br-int',has_traffic_filtering=True,id=16a8d1d7-b13a-4e80-906a-89a504b2e10a,network=Network(0d489fdb-4617-407d-8181-205ba807ec6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d1d7-b1') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG os_vif [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:df:e3,bridge_name='br-int',has_traffic_filtering=True,id=16a8d1d7-b13a-4e80-906a-89a504b2e10a,network=Network(0d489fdb-4617-407d-8181-205ba807ec6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d1d7-b1') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16a8d1d7-b1, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16a8d1d7-b1, col_values=(('external_ids', {'iface-id': '16a8d1d7-b13a-4e80-906a-89a504b2e10a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:df:e3', 'vm-uuid': '3640f710-270a-48d4-9ae6-ffe7780d5bc8'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Successfully updated port: 1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:07:41 user nova-compute[72815]: INFO os_vif [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:df:e3,bridge_name='br-int',has_traffic_filtering=True,id=16a8d1d7-b13a-4e80-906a-89a504b2e10a,network=Network(0d489fdb-4617-407d-8181-205ba807ec6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d1d7-b1')
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquired lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-6a2e36e9-7bab-4e15-a40d-27ce99947e76 req-7419d2f1-ca61-40d3-a44c-5d65abf3efc8 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Received event network-changed-1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-6a2e36e9-7bab-4e15-a40d-27ce99947e76 req-7419d2f1-ca61-40d3-a44c-5d65abf3efc8 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Refreshing instance network info cache due to event network-changed-1fdf5978-653e-4453-afdf-8d9cfc420666. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6a2e36e9-7bab-4e15-a40d-27ce99947e76 req-7419d2f1-ca61-40d3-a44c-5d65abf3efc8 service nova] Acquiring lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:07:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] No VIF found with MAC fa:16:3e:77:df:e3, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.network.neutron [req-150406ff-b720-4ed7-b398-bf45e7251e70 req-06a6e2d0-8b5a-451d-ad56-8c1c2e2bce80 service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Updated VIF entry in instance network info cache for port 16a8d1d7-b13a-4e80-906a-89a504b2e10a. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.network.neutron [req-150406ff-b720-4ed7-b398-bf45e7251e70 req-06a6e2d0-8b5a-451d-ad56-8c1c2e2bce80 service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Updating instance_info_cache with network_info: [{"id": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "address": "fa:16:3e:77:df:e3", "network": {"id": "0d489fdb-4617-407d-8181-205ba807ec6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a9954624a59348f3ab4e9691dd6f1b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d1d7-b1", "ovs_interfaceid": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-150406ff-b720-4ed7-b398-bf45e7251e70 req-06a6e2d0-8b5a-451d-ad56-8c1c2e2bce80 service nova] Releasing lock "refresh_cache-3640f710-270a-48d4-9ae6-ffe7780d5bc8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updating instance_info_cache with network_info: [{"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Releasing lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Instance network_info: |[{"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6a2e36e9-7bab-4e15-a40d-27ce99947e76 req-7419d2f1-ca61-40d3-a44c-5d65abf3efc8 service nova] Acquired lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.network.neutron [req-6a2e36e9-7bab-4e15-a40d-27ce99947e76 req-7419d2f1-ca61-40d3-a44c-5d65abf3efc8 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Refreshing network info cache for port 1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Start _get_guest_xml network_info=[{"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:07:42 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:07:42 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-188718305',display_name='tempest-SnapshotDataIntegrityTests-server-188718305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-188718305',id=34,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJARq4YtLUeaScgPTx+S8mFEgTezx/E/ls8lyBKcexD2cNEi+mEbxabl3USHGFy6tSXG72NQpfTfIlOA7tAhw6W+QLmvdxIQPvHwl9JwtgR31VUUS2Z90/t7sjJn+g2HEg==',key_name='tempest-keypair-736161106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4773a7956484abfbcd86cc1a89c8dfd',ramdisk_id='',reservation_id='r-pw8qxral',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-334514141',owner_user_name='tempest-SnapshotDataIntegrityTests-334514141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75682a0e782445619cbbb7781d3e37a0',uuid=99693a7e-71e3-4543-b649-41a147c77c7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Converting VIF {"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=1fdf5978-653e-4453-afdf-8d9cfc420666,network=Network(734045ff-cbb1-4195-9c43-508b9a929c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdf5978-65') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'pci_devices' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:07:42 user nova-compute[72815]:   <uuid>99693a7e-71e3-4543-b649-41a147c77c7e</uuid>
Aug 17 20:07:42 user nova-compute[72815]:   <name>instance-00000022</name>
Aug 17 20:07:42 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:07:42 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:07:42 user nova-compute[72815]:   <metadata>
Aug 17 20:07:42 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:07:42 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:07:42 user nova-compute[72815]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-188718305</nova:name>
Aug 17 20:07:42 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:07:42</nova:creationTime>
Aug 17 20:07:42 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:07:42 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:07:42 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:07:42 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:07:42 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:07:42 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:07:42 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:07:42 user nova-compute[72815]:       <nova:owner>
Aug 17 20:07:42 user nova-compute[72815]:         <nova:user uuid="75682a0e782445619cbbb7781d3e37a0">tempest-SnapshotDataIntegrityTests-334514141-project-member</nova:user>
Aug 17 20:07:42 user nova-compute[72815]:         <nova:project uuid="b4773a7956484abfbcd86cc1a89c8dfd">tempest-SnapshotDataIntegrityTests-334514141</nova:project>
Aug 17 20:07:42 user nova-compute[72815]:       </nova:owner>
Aug 17 20:07:42 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:07:42 user nova-compute[72815]:       <nova:ports>
Aug 17 20:07:42 user nova-compute[72815]:         <nova:port uuid="1fdf5978-653e-4453-afdf-8d9cfc420666">
Aug 17 20:07:42 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 20:07:42 user nova-compute[72815]:         </nova:port>
Aug 17 20:07:42 user nova-compute[72815]:       </nova:ports>
Aug 17 20:07:42 user nova-compute[72815]:     </nova:instance>
Aug 17 20:07:42 user nova-compute[72815]:   </metadata>
Aug 17 20:07:42 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:07:42 user nova-compute[72815]:     <system>
Aug 17 20:07:42 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:07:42 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:07:42 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:07:42 user nova-compute[72815]:       <entry name="serial">99693a7e-71e3-4543-b649-41a147c77c7e</entry>
Aug 17 20:07:42 user nova-compute[72815]:       <entry name="uuid">99693a7e-71e3-4543-b649-41a147c77c7e</entry>
Aug 17 20:07:42 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:07:42 user nova-compute[72815]:     </system>
Aug 17 20:07:42 user nova-compute[72815]:   </sysinfo>
Aug 17 20:07:42 user nova-compute[72815]:   <os>
Aug 17 20:07:42 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:07:42 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:07:42 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:07:42 user nova-compute[72815]:   </os>
Aug 17 20:07:42 user nova-compute[72815]:   <features>
Aug 17 20:07:42 user nova-compute[72815]:     <acpi/>
Aug 17 20:07:42 user nova-compute[72815]:     <apic/>
Aug 17 20:07:42 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:07:42 user nova-compute[72815]:   </features>
Aug 17 20:07:42 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:07:42 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:07:42 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:07:42 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:07:42 user nova-compute[72815]:   </clock>
Aug 17 20:07:42 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:07:42 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:07:42 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:07:42 user nova-compute[72815]:   </cpu>
Aug 17 20:07:42 user nova-compute[72815]:   <devices>
Aug 17 20:07:42 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:07:42 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:07:42 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk"/>
Aug 17 20:07:42 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:07:42 user nova-compute[72815]:     </disk>
Aug 17 20:07:42 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:07:42 user nova-compute[72815]:       <mac address="fa:16:3e:29:77:f9"/>
Aug 17 20:07:42 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:07:42 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:07:42 user nova-compute[72815]:       <target dev="tap1fdf5978-65"/>
Aug 17 20:07:42 user nova-compute[72815]:     </interface>
Aug 17 20:07:42 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:07:42 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/console.log" append="off"/>
Aug 17 20:07:42 user nova-compute[72815]:     </serial>
Aug 17 20:07:42 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:07:42 user nova-compute[72815]:     <video>
Aug 17 20:07:42 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:07:42 user nova-compute[72815]:     </video>
Aug 17 20:07:42 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:07:42 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:07:42 user nova-compute[72815]:     </rng>
Aug 17 20:07:42 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:07:42 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:07:42 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:07:42 user nova-compute[72815]:     </memballoon>
Aug 17 20:07:42 user nova-compute[72815]:   </devices>
Aug 17 20:07:42 user nova-compute[72815]: </domain>
Aug 17 20:07:42 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-188718305',display_name='tempest-SnapshotDataIntegrityTests-server-188718305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-188718305',id=34,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJARq4YtLUeaScgPTx+S8mFEgTezx/E/ls8lyBKcexD2cNEi+mEbxabl3USHGFy6tSXG72NQpfTfIlOA7tAhw6W+QLmvdxIQPvHwl9JwtgR31VUUS2Z90/t7sjJn+g2HEg==',key_name='tempest-keypair-736161106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4773a7956484abfbcd86cc1a89c8dfd',ramdisk_id='',reservation_id='r-pw8qxral',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-334514141',owner_user_name='tempest-SnapshotDataIntegrityTests-334514141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75682a0e782445619cbbb7781d3e37a0',uuid=99693a7e-71e3-4543-b649-41a147c77c7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Converting VIF {"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=1fdf5978-653e-4453-afdf-8d9cfc420666,network=Network(734045ff-cbb1-4195-9c43-508b9a929c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdf5978-65') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG os_vif [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=1fdf5978-653e-4453-afdf-8d9cfc420666,network=Network(734045ff-cbb1-4195-9c43-508b9a929c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdf5978-65') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fdf5978-65, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1fdf5978-65, col_values=(('external_ids', {'iface-id': '1fdf5978-653e-4453-afdf-8d9cfc420666', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:77:f9', 'vm-uuid': '99693a7e-71e3-4543-b649-41a147c77c7e'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:42 user nova-compute[72815]: INFO os_vif [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=1fdf5978-653e-4453-afdf-8d9cfc420666,network=Network(734045ff-cbb1-4195-9c43-508b9a929c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdf5978-65')
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:07:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] No VIF found with MAC fa:16:3e:29:77:f9, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:07:43 user nova-compute[72815]: DEBUG nova.network.neutron [req-6a2e36e9-7bab-4e15-a40d-27ce99947e76 req-7419d2f1-ca61-40d3-a44c-5d65abf3efc8 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updated VIF entry in instance network info cache for port 1fdf5978-653e-4453-afdf-8d9cfc420666. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:07:43 user nova-compute[72815]: DEBUG nova.network.neutron [req-6a2e36e9-7bab-4e15-a40d-27ce99947e76 req-7419d2f1-ca61-40d3-a44c-5d65abf3efc8 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updating instance_info_cache with network_info: [{"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6a2e36e9-7bab-4e15-a40d-27ce99947e76 req-7419d2f1-ca61-40d3-a44c-5d65abf3efc8 service nova] Releasing lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:07:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-c1ae13f0-af46-47c5-8ee9-bedfed7fc680 req-17b8a854-0fe1-4a96-8cb6-18c7bb95078e service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Received event network-vif-plugged-16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c1ae13f0-af46-47c5-8ee9-bedfed7fc680 req-17b8a854-0fe1-4a96-8cb6-18c7bb95078e service nova] Acquiring lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c1ae13f0-af46-47c5-8ee9-bedfed7fc680 req-17b8a854-0fe1-4a96-8cb6-18c7bb95078e service nova] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c1ae13f0-af46-47c5-8ee9-bedfed7fc680 req-17b8a854-0fe1-4a96-8cb6-18c7bb95078e service nova] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-c1ae13f0-af46-47c5-8ee9-bedfed7fc680 req-17b8a854-0fe1-4a96-8cb6-18c7bb95078e service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] No waiting events found dispatching network-vif-plugged-16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:43 user nova-compute[72815]: WARNING nova.compute.manager [req-c1ae13f0-af46-47c5-8ee9-bedfed7fc680 req-17b8a854-0fe1-4a96-8cb6-18c7bb95078e service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Received unexpected event network-vif-plugged-16a8d1d7-b13a-4e80-906a-89a504b2e10a for instance with vm_state building and task_state spawning.
Aug 17 20:07:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-9c6f85c0-746f-4883-a6fd-110174ba7d07 req-f3930ad7-06f3-48a5-9f1f-f3921399eb9b service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Received event network-vif-plugged-1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9c6f85c0-746f-4883-a6fd-110174ba7d07 req-f3930ad7-06f3-48a5-9f1f-f3921399eb9b service nova] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9c6f85c0-746f-4883-a6fd-110174ba7d07 req-f3930ad7-06f3-48a5-9f1f-f3921399eb9b service nova] Lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9c6f85c0-746f-4883-a6fd-110174ba7d07 req-f3930ad7-06f3-48a5-9f1f-f3921399eb9b service nova] Lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-9c6f85c0-746f-4883-a6fd-110174ba7d07 req-f3930ad7-06f3-48a5-9f1f-f3921399eb9b service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] No waiting events found dispatching network-vif-plugged-1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:45 user nova-compute[72815]: WARNING nova.compute.manager [req-9c6f85c0-746f-4883-a6fd-110174ba7d07 req-f3930ad7-06f3-48a5-9f1f-f3921399eb9b service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Received unexpected event network-vif-plugged-1fdf5978-653e-4453-afdf-8d9cfc420666 for instance with vm_state building and task_state spawning.
Aug 17 20:07:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-9264ebae-8edf-4bd4-baf5-a764307d570f req-44fdd420-5e7e-4d26-b2f0-1a491047e74e service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Received event network-vif-plugged-16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9264ebae-8edf-4bd4-baf5-a764307d570f req-44fdd420-5e7e-4d26-b2f0-1a491047e74e service nova] Acquiring lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9264ebae-8edf-4bd4-baf5-a764307d570f req-44fdd420-5e7e-4d26-b2f0-1a491047e74e service nova] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9264ebae-8edf-4bd4-baf5-a764307d570f req-44fdd420-5e7e-4d26-b2f0-1a491047e74e service nova] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-9264ebae-8edf-4bd4-baf5-a764307d570f req-44fdd420-5e7e-4d26-b2f0-1a491047e74e service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] No waiting events found dispatching network-vif-plugged-16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:46 user nova-compute[72815]: WARNING nova.compute.manager [req-9264ebae-8edf-4bd4-baf5-a764307d570f req-44fdd420-5e7e-4d26-b2f0-1a491047e74e service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Received unexpected event network-vif-plugged-16a8d1d7-b13a-4e80-906a-89a504b2e10a for instance with vm_state building and task_state spawning.
Aug 17 20:07:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302867.089131, 3640f710-270a-48d4-9ae6-ffe7780d5bc8 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] VM Resumed (Lifecycle Event)
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Instance spawned successfully.
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302867.0907233, 3640f710-270a-48d4-9ae6-ffe7780d5bc8 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] VM Started (Lifecycle Event)
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Instance spawned successfully.
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-7b7c0912-c769-4b80-a563-02946d75b17d req-0f2d3d90-fb50-4eac-a397-2c85b5f37351 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Received event network-vif-plugged-1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7b7c0912-c769-4b80-a563-02946d75b17d req-0f2d3d90-fb50-4eac-a397-2c85b5f37351 service nova] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7b7c0912-c769-4b80-a563-02946d75b17d req-0f2d3d90-fb50-4eac-a397-2c85b5f37351 service nova] Lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7b7c0912-c769-4b80-a563-02946d75b17d req-0f2d3d90-fb50-4eac-a397-2c85b5f37351 service nova] Lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-7b7c0912-c769-4b80-a563-02946d75b17d req-0f2d3d90-fb50-4eac-a397-2c85b5f37351 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] No waiting events found dispatching network-vif-plugged-1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:07:47 user nova-compute[72815]: WARNING nova.compute.manager [req-7b7c0912-c769-4b80-a563-02946d75b17d req-0f2d3d90-fb50-4eac-a397-2c85b5f37351 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Received unexpected event network-vif-plugged-1fdf5978-653e-4453-afdf-8d9cfc420666 for instance with vm_state building and task_state spawning.
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302867.1442196, 99693a7e-71e3-4543-b649-41a147c77c7e => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] VM Resumed (Lifecycle Event)
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.compute.manager [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Took 7.64 seconds to spawn the instance on the hypervisor.
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.compute.manager [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Took 6.77 seconds to spawn the instance on the hypervisor.
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302867.2081773, 99693a7e-71e3-4543-b649-41a147c77c7e => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] VM Started (Lifecycle Event)
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.compute.manager [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Took 8.64 seconds to build instance.
Aug 17 20:07:47 user nova-compute[72815]: INFO nova.compute.manager [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Took 8.55 seconds to build instance.
Aug 17 20:07:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-182761fe-e52a-4b71-8a53-456db6bf79fa tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.757s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2afdb56e-f912-4da2-807e-72bab6c9ae29 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.678s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:07:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:53 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302858.55153, 634e7522-f51c-4556-827f-18ec5fee230a => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:07:53 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] VM Stopped (Lifecycle Event)
Aug 17 20:07:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-fcad05fd-0ad1-44ab-9994-77e4f8270dae None None] [instance: 634e7522-f51c-4556-827f-18ec5fee230a] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:07:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-89761964-9906-456d-94d3-f4607a5aeb7c req-0ca2a4b3-0f11-4669-ac24-e0298be05972 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-changed-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:07:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-89761964-9906-456d-94d3-f4607a5aeb7c req-0ca2a4b3-0f11-4669-ac24-e0298be05972 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Refreshing instance network info cache due to event network-changed-defc548f-4a74-4cdf-b1a8-12236dcf71e9. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:07:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-89761964-9906-456d-94d3-f4607a5aeb7c req-0ca2a4b3-0f11-4669-ac24-e0298be05972 service nova] Acquiring lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:07:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-89761964-9906-456d-94d3-f4607a5aeb7c req-0ca2a4b3-0f11-4669-ac24-e0298be05972 service nova] Acquired lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:07:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-89761964-9906-456d-94d3-f4607a5aeb7c req-0ca2a4b3-0f11-4669-ac24-e0298be05972 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Refreshing network info cache for port defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:07:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-89761964-9906-456d-94d3-f4607a5aeb7c req-0ca2a4b3-0f11-4669-ac24-e0298be05972 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updated VIF entry in instance network info cache for port defc548f-4a74-4cdf-b1a8-12236dcf71e9. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:07:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-89761964-9906-456d-94d3-f4607a5aeb7c req-0ca2a4b3-0f11-4669-ac24-e0298be05972 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updating instance_info_cache with network_info: [{"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:07:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-89761964-9906-456d-94d3-f4607a5aeb7c req-0ca2a4b3-0f11-4669-ac24-e0298be05972 service nova] Releasing lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:07:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:07:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "e7e09061-f65f-444b-98f6-409da28295e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:08:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:08:00 user nova-compute[72815]: INFO nova.compute.claims [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Claim successful on node user
Aug 17 20:08:01 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:08:01 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:08:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG nova.policy [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa27c69e40f243d9b38c87250b5dba5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6d2cf2910f4d3d9924480d68057b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:08:01 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Creating image(s)
Aug 17 20:08:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "/opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "/opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.222s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:01 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk 1073741824" returned: 0 in 0.054s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Successfully created port: 7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.224s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Cannot resize image /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'migration_context' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Ensure instance console log exists: /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:02 user nova-compute[72815]: INFO nova.compute.manager [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Shelving
Aug 17 20:08:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Successfully updated port: 7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-82272837-a4d0-442e-8a33-a8baab71eb36 req-8ec6244b-4ab9-4528-a606-46f49a76c5ec service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-vif-unplugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-82272837-a4d0-442e-8a33-a8baab71eb36 req-8ec6244b-4ab9-4528-a606-46f49a76c5ec service nova] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-82272837-a4d0-442e-8a33-a8baab71eb36 req-8ec6244b-4ab9-4528-a606-46f49a76c5ec service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-82272837-a4d0-442e-8a33-a8baab71eb36 req-8ec6244b-4ab9-4528-a606-46f49a76c5ec service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-82272837-a4d0-442e-8a33-a8baab71eb36 req-8ec6244b-4ab9-4528-a606-46f49a76c5ec service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] No waiting events found dispatching network-vif-unplugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:08:03 user nova-compute[72815]: WARNING nova.compute.manager [req-82272837-a4d0-442e-8a33-a8baab71eb36 req-8ec6244b-4ab9-4528-a606-46f49a76c5ec service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received unexpected event network-vif-unplugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 for instance with vm_state active and task_state shelving.
Aug 17 20:08:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquired lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-f2212145-b7ed-403f-8dff-fb8491ba7e43 req-2ada2468-b31f-4dba-89ca-4d3265dd8bd4 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-changed-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-f2212145-b7ed-403f-8dff-fb8491ba7e43 req-2ada2468-b31f-4dba-89ca-4d3265dd8bd4 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Refreshing instance network info cache due to event network-changed-7a6d3944-52f6-4ffc-81d1-f648b2b44f59. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f2212145-b7ed-403f-8dff-fb8491ba7e43 req-2ada2468-b31f-4dba-89ca-4d3265dd8bd4 service nova] Acquiring lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:03 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Instance destroyed successfully.
Aug 17 20:08:03 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Beginning cold snapshot process
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updating instance_info_cache with network_info: [{"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Releasing lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Instance network_info: |[{"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f2212145-b7ed-403f-8dff-fb8491ba7e43 req-2ada2468-b31f-4dba-89ca-4d3265dd8bd4 service nova] Acquired lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.network.neutron [req-f2212145-b7ed-403f-8dff-fb8491ba7e43 req-2ada2468-b31f-4dba-89ca-4d3265dd8bd4 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Refreshing network info cache for port 7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Start _get_guest_xml network_info=[{"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:08:03 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:08:03 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2100679262',display_name='tempest-ServerRescueNegativeTestJSON-server-2100679262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2100679262',id=35,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQVuZd8HY1YPAnMPmmsKQMN4BVcIIqgoZWCg993IqB30y+h05kxKBZmQl9HxcfNKYfglRHgFsde7WW/VjaU0fJe/3jwAEIqfff8lEApN4BAQw9wX0KAw+Voy57bKwOKLg==',key_name='tempest-keypair-1902815982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6d2cf2910f4d3d9924480d68057b5a',ramdisk_id='',reservation_id='r-g1lbtbjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-335799606',owner_user_name='tempest-ServerRescueNegativeTestJSON-335799606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa27c69e40f243d9b38c87250b5dba5f',uuid=e7e09061-f65f-444b-98f6-409da28295e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converting VIF {"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fd:56,bridge_name='br-int',has_traffic_filtering=True,id=7a6d3944-52f6-4ffc-81d1-f648b2b44f59,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d3944-52') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'pci_devices' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk /opt/stack/data/nova/instances/snapshots/tmpc7v30x31/6f02ea37c9c44dd5aba348b9fbafbf56 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:08:03 user nova-compute[72815]:   <uuid>e7e09061-f65f-444b-98f6-409da28295e2</uuid>
Aug 17 20:08:03 user nova-compute[72815]:   <name>instance-00000023</name>
Aug 17 20:08:03 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:08:03 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:08:03 user nova-compute[72815]:   <metadata>
Aug 17 20:08:03 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:08:03 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:08:03 user nova-compute[72815]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2100679262</nova:name>
Aug 17 20:08:03 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:08:03</nova:creationTime>
Aug 17 20:08:03 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:08:03 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:08:03 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:08:03 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:08:03 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:08:03 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:08:03 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:08:03 user nova-compute[72815]:       <nova:owner>
Aug 17 20:08:03 user nova-compute[72815]:         <nova:user uuid="fa27c69e40f243d9b38c87250b5dba5f">tempest-ServerRescueNegativeTestJSON-335799606-project-member</nova:user>
Aug 17 20:08:03 user nova-compute[72815]:         <nova:project uuid="4e6d2cf2910f4d3d9924480d68057b5a">tempest-ServerRescueNegativeTestJSON-335799606</nova:project>
Aug 17 20:08:03 user nova-compute[72815]:       </nova:owner>
Aug 17 20:08:03 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:08:03 user nova-compute[72815]:       <nova:ports>
Aug 17 20:08:03 user nova-compute[72815]:         <nova:port uuid="7a6d3944-52f6-4ffc-81d1-f648b2b44f59">
Aug 17 20:08:03 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 20:08:03 user nova-compute[72815]:         </nova:port>
Aug 17 20:08:03 user nova-compute[72815]:       </nova:ports>
Aug 17 20:08:03 user nova-compute[72815]:     </nova:instance>
Aug 17 20:08:03 user nova-compute[72815]:   </metadata>
Aug 17 20:08:03 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:08:03 user nova-compute[72815]:     <system>
Aug 17 20:08:03 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:08:03 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:08:03 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:08:03 user nova-compute[72815]:       <entry name="serial">e7e09061-f65f-444b-98f6-409da28295e2</entry>
Aug 17 20:08:03 user nova-compute[72815]:       <entry name="uuid">e7e09061-f65f-444b-98f6-409da28295e2</entry>
Aug 17 20:08:03 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:08:03 user nova-compute[72815]:     </system>
Aug 17 20:08:03 user nova-compute[72815]:   </sysinfo>
Aug 17 20:08:03 user nova-compute[72815]:   <os>
Aug 17 20:08:03 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:08:03 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:08:03 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:08:03 user nova-compute[72815]:   </os>
Aug 17 20:08:03 user nova-compute[72815]:   <features>
Aug 17 20:08:03 user nova-compute[72815]:     <acpi/>
Aug 17 20:08:03 user nova-compute[72815]:     <apic/>
Aug 17 20:08:03 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:08:03 user nova-compute[72815]:   </features>
Aug 17 20:08:03 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:08:03 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:08:03 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:08:03 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:08:03 user nova-compute[72815]:   </clock>
Aug 17 20:08:03 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:08:03 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:08:03 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:08:03 user nova-compute[72815]:   </cpu>
Aug 17 20:08:03 user nova-compute[72815]:   <devices>
Aug 17 20:08:03 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:08:03 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:08:03 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk"/>
Aug 17 20:08:03 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:08:03 user nova-compute[72815]:     </disk>
Aug 17 20:08:03 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:08:03 user nova-compute[72815]:       <mac address="fa:16:3e:c4:fd:56"/>
Aug 17 20:08:03 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:08:03 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:08:03 user nova-compute[72815]:       <target dev="tap7a6d3944-52"/>
Aug 17 20:08:03 user nova-compute[72815]:     </interface>
Aug 17 20:08:03 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:08:03 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/console.log" append="off"/>
Aug 17 20:08:03 user nova-compute[72815]:     </serial>
Aug 17 20:08:03 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:08:03 user nova-compute[72815]:     <video>
Aug 17 20:08:03 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:08:03 user nova-compute[72815]:     </video>
Aug 17 20:08:03 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:08:03 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:08:03 user nova-compute[72815]:     </rng>
Aug 17 20:08:03 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:08:03 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:08:03 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:08:03 user nova-compute[72815]:     </memballoon>
Aug 17 20:08:03 user nova-compute[72815]:   </devices>
Aug 17 20:08:03 user nova-compute[72815]: </domain>
Aug 17 20:08:03 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2100679262',display_name='tempest-ServerRescueNegativeTestJSON-server-2100679262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2100679262',id=35,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQVuZd8HY1YPAnMPmmsKQMN4BVcIIqgoZWCg993IqB30y+h05kxKBZmQl9HxcfNKYfglRHgFsde7WW/VjaU0fJe/3jwAEIqfff8lEApN4BAQw9wX0KAw+Voy57bKwOKLg==',key_name='tempest-keypair-1902815982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6d2cf2910f4d3d9924480d68057b5a',ramdisk_id='',reservation_id='r-g1lbtbjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-335799606',owner_user_name='tempest-ServerRescueNegativeTestJSON-335799606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa27c69e40f243d9b38c87250b5dba5f',uuid=e7e09061-f65f-444b-98f6-409da28295e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converting VIF {"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fd:56,bridge_name='br-int',has_traffic_filtering=True,id=7a6d3944-52f6-4ffc-81d1-f648b2b44f59,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d3944-52') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG os_vif [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fd:56,bridge_name='br-int',has_traffic_filtering=True,id=7a6d3944-52f6-4ffc-81d1-f648b2b44f59,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d3944-52') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a6d3944-52, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a6d3944-52, col_values=(('external_ids', {'iface-id': '7a6d3944-52f6-4ffc-81d1-f648b2b44f59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:fd:56', 'vm-uuid': 'e7e09061-f65f-444b-98f6-409da28295e2'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:03 user nova-compute[72815]: INFO os_vif [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fd:56,bridge_name='br-int',has_traffic_filtering=True,id=7a6d3944-52f6-4ffc-81d1-f648b2b44f59,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d3944-52')
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:08:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No VIF found with MAC fa:16:3e:c4:fd:56, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:08:04 user nova-compute[72815]: DEBUG nova.network.neutron [req-f2212145-b7ed-403f-8dff-fb8491ba7e43 req-2ada2468-b31f-4dba-89ca-4d3265dd8bd4 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updated VIF entry in instance network info cache for port 7a6d3944-52f6-4ffc-81d1-f648b2b44f59. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:08:04 user nova-compute[72815]: DEBUG nova.network.neutron [req-f2212145-b7ed-403f-8dff-fb8491ba7e43 req-2ada2468-b31f-4dba-89ca-4d3265dd8bd4 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updating instance_info_cache with network_info: [{"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:08:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f2212145-b7ed-403f-8dff-fb8491ba7e43 req-2ada2468-b31f-4dba-89ca-4d3265dd8bd4 service nova] Releasing lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:08:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk /opt/stack/data/nova/instances/snapshots/tmpc7v30x31/6f02ea37c9c44dd5aba348b9fbafbf56" returned: 0 in 0.728s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:04 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Snapshot extracted, beginning image upload
Aug 17 20:08:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-4b9e92ba-6585-4150-acd5-da70ea5a8d97 req-193d7e37-640f-422f-b765-296024ea2020 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4b9e92ba-6585-4150-acd5-da70ea5a8d97 req-193d7e37-640f-422f-b765-296024ea2020 service nova] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4b9e92ba-6585-4150-acd5-da70ea5a8d97 req-193d7e37-640f-422f-b765-296024ea2020 service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4b9e92ba-6585-4150-acd5-da70ea5a8d97 req-193d7e37-640f-422f-b765-296024ea2020 service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-4b9e92ba-6585-4150-acd5-da70ea5a8d97 req-193d7e37-640f-422f-b765-296024ea2020 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] No waiting events found dispatching network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:08:05 user nova-compute[72815]: WARNING nova.compute.manager [req-4b9e92ba-6585-4150-acd5-da70ea5a8d97 req-193d7e37-640f-422f-b765-296024ea2020 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received unexpected event network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 20:08:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:06 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Snapshot image upload complete
Aug 17 20:08:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:08:06 user nova-compute[72815]: INFO nova.compute.manager [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Shelve offloading
Aug 17 20:08:06 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Instance destroyed successfully.
Aug 17 20:08:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:08:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:08:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquired lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:08:06 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:08:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-b60ecb6c-e233-4b34-9cf7-17d5a4db161f req-2d2c69e3-4c9c-404c-83a1-8696ceadceaf service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b60ecb6c-e233-4b34-9cf7-17d5a4db161f req-2d2c69e3-4c9c-404c-83a1-8696ceadceaf service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b60ecb6c-e233-4b34-9cf7-17d5a4db161f req-2d2c69e3-4c9c-404c-83a1-8696ceadceaf service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b60ecb6c-e233-4b34-9cf7-17d5a4db161f req-2d2c69e3-4c9c-404c-83a1-8696ceadceaf service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-b60ecb6c-e233-4b34-9cf7-17d5a4db161f req-2d2c69e3-4c9c-404c-83a1-8696ceadceaf service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:08:07 user nova-compute[72815]: WARNING nova.compute.manager [req-b60ecb6c-e233-4b34-9cf7-17d5a4db161f req-2d2c69e3-4c9c-404c-83a1-8696ceadceaf service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state building and task_state spawning.
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-b60ecb6c-e233-4b34-9cf7-17d5a4db161f req-2d2c69e3-4c9c-404c-83a1-8696ceadceaf service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b60ecb6c-e233-4b34-9cf7-17d5a4db161f req-2d2c69e3-4c9c-404c-83a1-8696ceadceaf service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b60ecb6c-e233-4b34-9cf7-17d5a4db161f req-2d2c69e3-4c9c-404c-83a1-8696ceadceaf service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b60ecb6c-e233-4b34-9cf7-17d5a4db161f req-2d2c69e3-4c9c-404c-83a1-8696ceadceaf service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-b60ecb6c-e233-4b34-9cf7-17d5a4db161f req-2d2c69e3-4c9c-404c-83a1-8696ceadceaf service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:08:07 user nova-compute[72815]: WARNING nova.compute.manager [req-b60ecb6c-e233-4b34-9cf7-17d5a4db161f req-2d2c69e3-4c9c-404c-83a1-8696ceadceaf service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state building and task_state spawning.
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updating instance_info_cache with network_info: [{"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Releasing lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302887.2450094, e7e09061-f65f-444b-98f6-409da28295e2 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:08:07 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] VM Resumed (Lifecycle Event)
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:08:07 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Instance spawned successfully.
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:08:07 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302887.252067, e7e09061-f65f-444b-98f6-409da28295e2 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:08:07 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] VM Started (Lifecycle Event)
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:08:07 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:08:07 user nova-compute[72815]: INFO nova.compute.manager [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:08:07 user nova-compute[72815]: INFO nova.compute.manager [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Took 6.67 seconds to build instance.
Aug 17 20:08:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2f6ce0f2-ea11-4beb-b518-b1b253502a87 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "e7e09061-f65f-444b-98f6-409da28295e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.791s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:07 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Instance destroyed successfully.
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.objects.instance [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'resources' on Instance uuid 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-592611439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-592611439',id=31,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCNKJMEO1Iytsf6/eVE9Y1d1Ku4ylaFFaVwjCGf7SFQEDJ72TegDIOZqXt942HFg78gbDzYNttm/7+HntlcJ5blGKKCBKylGb8Q6G5S2YBjjsIScxsDUCsXsFIGuZTZKQ==',key_name='tempest-keypair-1811635152',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:06:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='aa140294f17e4751b13e2d4a15b17ff9',ramdisk_id='',reservation_id='r-08iiaggg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-632866040',owner_user_name='tempest-AttachVolumeShelveTestJSON-632866040-project-member',shelved_at='2023-08-17T20:08:06.653035',shelved_host='user',shelved_image_id='2f5d1c55-471b-4029-804e-cdb6b773c42c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82d9b206cf4499eaf518f7cd6a7a10c',uuid=2ed62592-a25a-46cf-976a-5f2edbe6d5e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converting VIF {"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG os_vif [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdefc548f-4a, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-60bac69c-ee37-4adf-9537-d725c88b8151 req-83e0110c-d6b0-4040-af34-6aa3a50eda23 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-changed-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-60bac69c-ee37-4adf-9537-d725c88b8151 req-83e0110c-d6b0-4040-af34-6aa3a50eda23 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Refreshing instance network info cache due to event network-changed-defc548f-4a74-4cdf-b1a8-12236dcf71e9. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-60bac69c-ee37-4adf-9537-d725c88b8151 req-83e0110c-d6b0-4040-af34-6aa3a50eda23 service nova] Acquiring lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-60bac69c-ee37-4adf-9537-d725c88b8151 req-83e0110c-d6b0-4040-af34-6aa3a50eda23 service nova] Acquired lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG nova.network.neutron [req-60bac69c-ee37-4adf-9537-d725c88b8151 req-83e0110c-d6b0-4040-af34-6aa3a50eda23 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Refreshing network info cache for port defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:08:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:08:07 user nova-compute[72815]: INFO os_vif [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a')
Aug 17 20:08:07 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Deleting instance files /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0_del
Aug 17 20:08:07 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Deletion of /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0_del complete
Aug 17 20:08:08 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Deleted allocations for instance 2ed62592-a25a-46cf-976a-5f2edbe6d5e0
Aug 17 20:08:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:08 user nova-compute[72815]: DEBUG nova.objects.instance [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'numa_topology' on Instance uuid 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:08:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-60bac69c-ee37-4adf-9537-d725c88b8151 req-83e0110c-d6b0-4040-af34-6aa3a50eda23 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updated VIF entry in instance network info cache for port defc548f-4a74-4cdf-b1a8-12236dcf71e9. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:08:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-60bac69c-ee37-4adf-9537-d725c88b8151 req-83e0110c-d6b0-4040-af34-6aa3a50eda23 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updating instance_info_cache with network_info: [{"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdefc548f-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:08:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-60bac69c-ee37-4adf-9537-d725c88b8151 req-83e0110c-d6b0-4040-af34-6aa3a50eda23 service nova] Releasing lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:08:08 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:08:08 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:08:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.539s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e1d28b20-d720-4be1-a986-ad6e88e40f79 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.029s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:18 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302883.2847524, 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:08:18 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] VM Stopped (Lifecycle Event)
Aug 17 20:08:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-27ebf945-8e45-41be-b0c9-a1bc10f1366b None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:08:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:29 user nova-compute[72815]: INFO nova.compute.manager [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Detaching volume d12e820b-89b6-41bf-ab5f-f714a166bbd4
Aug 17 20:08:29 user nova-compute[72815]: INFO nova.virt.block_device [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Attempting to driver detach volume d12e820b-89b6-41bf-ab5f-f714a166bbd4 from mountpoint /dev/vdb
Aug 17 20:08:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Attempting to detach device vdb from instance 72c9428f-f797-46b4-9780-d2a4abb01ae7 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:08:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:08:29 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:08:29 user nova-compute[72815]:   <source dev="/dev/sde"/>
Aug 17 20:08:29 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:08:29 user nova-compute[72815]:   <serial>d12e820b-89b6-41bf-ab5f-f714a166bbd4</serial>
Aug 17 20:08:29 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:08:29 user nova-compute[72815]: </disk>
Aug 17 20:08:29 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:08:29 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully detached device vdb from instance 72c9428f-f797-46b4-9780-d2a4abb01ae7 from the persistent domain config.
Aug 17 20:08:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72c9428f-f797-46b4-9780-d2a4abb01ae7 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:08:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:08:29 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:08:29 user nova-compute[72815]:   <source dev="/dev/sde"/>
Aug 17 20:08:29 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:08:29 user nova-compute[72815]:   <serial>d12e820b-89b6-41bf-ab5f-f714a166bbd4</serial>
Aug 17 20:08:29 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:08:29 user nova-compute[72815]: </disk>
Aug 17 20:08:29 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692302910.336149, 72c9428f-f797-46b4-9780-d2a4abb01ae7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72c9428f-f797-46b4-9780-d2a4abb01ae7 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:08:30 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully detached device vdb from instance 72c9428f-f797-46b4-9780-d2a4abb01ae7 from the live domain config.
Aug 17 20:08:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtmIoRpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:08:30 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1e9517-5283-4a18-8769-9ac0c18887d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[52818ce8-6de8-40a3-8175-bcaab666cc7d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:08:30 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:08:30 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:08:30 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:08:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:08:30 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:08:30 user nova-compute[72815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 (non-flash)
Aug 17 20:08:30 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:08:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b44e2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4'): ({'sde'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Removing single pathed devices sde {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[331fe3ea-dffe-4cb4-9e21-51b95b963f68]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a73c674-2d65-4307-8948-e37a1e0c07c7]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Flushing IO for device /dev/sde {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[94463b8c-a5ba-4378-bf9d-2599cda14f69]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[712a897f-2809-4bbe-b994-c9aa2cc2371a]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[096ed38e-d910-4535-be08-4755c61c8624]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f82c23-294e-4618-a6ba-1cb17b694200]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4, portal: 172.16.0.220,3260]
Aug 17 20:08:30 user nova-compute[72815]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4, portal: 172.16.0.220,3260] successful.
Aug 17 20:08:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d12e820b-89b6-41bf-ab5f-f714a166bbd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7370785-e193-408f-b3d4-bb38032ae037]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] <== disconnect_volume: return (290ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:08:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:08:31 user nova-compute[72815]: DEBUG nova.objects.instance [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'flavor' on Instance uuid 72c9428f-f797-46b4-9780-d2a4abb01ae7 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:08:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-34fce54e-f773-4b34-b7dd-4dccf7d99cf3 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.699s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:31 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:08:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:31 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:08:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:08:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:08:32 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:33 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:08:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:37 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:08:37 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=6717MB free_disk=25.141677856445312GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Applying migration context for instance 4c630764-4e1b-4bab-b354-1389cd60f5a5 as it has an incoming, in-progress migration 65d0cdd3-5c78-4663-9138-7a4d52ef7045. Migration status is finished {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 20:08:37 user nova-compute[72815]: INFO nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updating resource usage from migration 65d0cdd3-5c78-4663-9138-7a4d52ef7045
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 12a34846-1670-4c6c-ac7d-522530aaf3a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 72c9428f-f797-46b4-9780-d2a4abb01ae7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance caffa446-5b29-4c5d-b756-4cc7119676cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 8ac64ac9-a49d-4c70-956b-3a140da5ede8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Migration 65d0cdd3-5c78-4663-9138-7a4d52ef7045 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 4c630764-4e1b-4bab-b354-1389cd60f5a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 3640f710-270a-48d4-9ae6-ffe7780d5bc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 99693a7e-71e3-4543-b649-41a147c77c7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance e7e09061-f65f-444b-98f6-409da28295e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:08:37 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:08:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:08:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:08:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:08:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:08:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 20:08:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:08:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:08:40 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:08:40 user nova-compute[72815]: DEBUG nova.objects.instance [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lazy-loading 'info_cache' on Instance uuid 1a714bfa-0b06-4ef8-865a-819abbc64be5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:08:40 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Updating instance_info_cache with network_info: [{"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:08:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-1a714bfa-0b06-4ef8-865a-819abbc64be5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:08:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:08:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:08:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:08:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:08:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:08:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:08:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:08:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:08:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:08:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:08:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:08:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:08:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "690ec89d-7800-4062-a912-7b7d38474b59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "690ec89d-7800-4062-a912-7b7d38474b59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:08:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:43 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:08:43 user nova-compute[72815]: INFO nova.compute.claims [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Claim successful on node user
Aug 17 20:08:44 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:08:44 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:08:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG nova.policy [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c18f1cf89be4c63a7ad48ec390c6213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68603e63804620b9bacd300d254000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:08:44 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Creating image(s)
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "/opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "/opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "/opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.195s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.173s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk 1073741824" returned: 0 in 0.055s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:45 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Successfully created port: b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:08:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.209s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:45 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:08:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:08:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:08:45 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Cannot resize image /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:08:45 user nova-compute[72815]: DEBUG nova.objects.instance [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lazy-loading 'migration_context' on Instance uuid 690ec89d-7800-4062-a912-7b7d38474b59 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:08:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:08:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Ensure instance console log exists: /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:08:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Successfully updated port: b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "refresh_cache-690ec89d-7800-4062-a912-7b7d38474b59" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquired lock "refresh_cache-690ec89d-7800-4062-a912-7b7d38474b59" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-296aec56-8555-479b-b759-331192880cb5 req-2648f005-fbad-4fb0-b0c9-3ab067d64ec5 service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Received event network-changed-b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-296aec56-8555-479b-b759-331192880cb5 req-2648f005-fbad-4fb0-b0c9-3ab067d64ec5 service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Refreshing instance network info cache due to event network-changed-b891ebda-fc59-46c7-be66-25ab4446c7c1. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-296aec56-8555-479b-b759-331192880cb5 req-2648f005-fbad-4fb0-b0c9-3ab067d64ec5 service nova] Acquiring lock "refresh_cache-690ec89d-7800-4062-a912-7b7d38474b59" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:08:46 user nova-compute[72815]: INFO nova.compute.manager [None req-0c16cd3d-e6c1-4558-8b20-0202030fac69 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Unrescuing
Aug 17 20:08:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0c16cd3d-e6c1-4558-8b20-0202030fac69 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "refresh_cache-caffa446-5b29-4c5d-b756-4cc7119676cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0c16cd3d-e6c1-4558-8b20-0202030fac69 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquired lock "refresh_cache-caffa446-5b29-4c5d-b756-4cc7119676cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0c16cd3d-e6c1-4558-8b20-0202030fac69 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Updating instance_info_cache with network_info: [{"id": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "address": "fa:16:3e:9a:ea:b9", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb891ebda-fc", "ovs_interfaceid": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Releasing lock "refresh_cache-690ec89d-7800-4062-a912-7b7d38474b59" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Instance network_info: |[{"id": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "address": "fa:16:3e:9a:ea:b9", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb891ebda-fc", "ovs_interfaceid": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-296aec56-8555-479b-b759-331192880cb5 req-2648f005-fbad-4fb0-b0c9-3ab067d64ec5 service nova] Acquired lock "refresh_cache-690ec89d-7800-4062-a912-7b7d38474b59" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.network.neutron [req-296aec56-8555-479b-b759-331192880cb5 req-2648f005-fbad-4fb0-b0c9-3ab067d64ec5 service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Refreshing network info cache for port b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Start _get_guest_xml network_info=[{"id": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "address": "fa:16:3e:9a:ea:b9", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb891ebda-fc", "ovs_interfaceid": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:08:46 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:08:46 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-981235990',display_name='tempest-ServersNegativeTestJSON-server-981235990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-981235990',id=36,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d68603e63804620b9bacd300d254000',ramdisk_id='',reservation_id='r-c0fbep2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-128301023',owner_user_name='tempest-ServersNegativeTestJSON-128301023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:08:44Z,user_data=None,user_id='1c18f1cf89be4c63a7ad48ec390c6213',uuid=690ec89d-7800-4062-a912-7b7d38474b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "address": "fa:16:3e:9a:ea:b9", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb891ebda-fc", "ovs_interfaceid": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Converting VIF {"id": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "address": "fa:16:3e:9a:ea:b9", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb891ebda-fc", "ovs_interfaceid": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=b891ebda-fc59-46c7-be66-25ab4446c7c1,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb891ebda-fc') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.objects.instance [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lazy-loading 'pci_devices' on Instance uuid 690ec89d-7800-4062-a912-7b7d38474b59 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:08:46 user nova-compute[72815]:   <uuid>690ec89d-7800-4062-a912-7b7d38474b59</uuid>
Aug 17 20:08:46 user nova-compute[72815]:   <name>instance-00000024</name>
Aug 17 20:08:46 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:08:46 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:08:46 user nova-compute[72815]:   <metadata>
Aug 17 20:08:46 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:08:46 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:08:46 user nova-compute[72815]:       <nova:name>tempest-ServersNegativeTestJSON-server-981235990</nova:name>
Aug 17 20:08:46 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:08:46</nova:creationTime>
Aug 17 20:08:46 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:08:46 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:08:46 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:08:46 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:08:46 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:08:46 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:08:46 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:08:46 user nova-compute[72815]:       <nova:owner>
Aug 17 20:08:46 user nova-compute[72815]:         <nova:user uuid="1c18f1cf89be4c63a7ad48ec390c6213">tempest-ServersNegativeTestJSON-128301023-project-member</nova:user>
Aug 17 20:08:46 user nova-compute[72815]:         <nova:project uuid="2d68603e63804620b9bacd300d254000">tempest-ServersNegativeTestJSON-128301023</nova:project>
Aug 17 20:08:46 user nova-compute[72815]:       </nova:owner>
Aug 17 20:08:46 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:08:46 user nova-compute[72815]:       <nova:ports>
Aug 17 20:08:46 user nova-compute[72815]:         <nova:port uuid="b891ebda-fc59-46c7-be66-25ab4446c7c1">
Aug 17 20:08:46 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 20:08:46 user nova-compute[72815]:         </nova:port>
Aug 17 20:08:46 user nova-compute[72815]:       </nova:ports>
Aug 17 20:08:46 user nova-compute[72815]:     </nova:instance>
Aug 17 20:08:46 user nova-compute[72815]:   </metadata>
Aug 17 20:08:46 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:08:46 user nova-compute[72815]:     <system>
Aug 17 20:08:46 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:08:46 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:08:46 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:08:46 user nova-compute[72815]:       <entry name="serial">690ec89d-7800-4062-a912-7b7d38474b59</entry>
Aug 17 20:08:46 user nova-compute[72815]:       <entry name="uuid">690ec89d-7800-4062-a912-7b7d38474b59</entry>
Aug 17 20:08:46 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:08:46 user nova-compute[72815]:     </system>
Aug 17 20:08:46 user nova-compute[72815]:   </sysinfo>
Aug 17 20:08:46 user nova-compute[72815]:   <os>
Aug 17 20:08:46 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:08:46 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:08:46 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:08:46 user nova-compute[72815]:   </os>
Aug 17 20:08:46 user nova-compute[72815]:   <features>
Aug 17 20:08:46 user nova-compute[72815]:     <acpi/>
Aug 17 20:08:46 user nova-compute[72815]:     <apic/>
Aug 17 20:08:46 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:08:46 user nova-compute[72815]:   </features>
Aug 17 20:08:46 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:08:46 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:08:46 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:08:46 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:08:46 user nova-compute[72815]:   </clock>
Aug 17 20:08:46 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:08:46 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:08:46 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:08:46 user nova-compute[72815]:   </cpu>
Aug 17 20:08:46 user nova-compute[72815]:   <devices>
Aug 17 20:08:46 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:08:46 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:08:46 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk"/>
Aug 17 20:08:46 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:08:46 user nova-compute[72815]:     </disk>
Aug 17 20:08:46 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:08:46 user nova-compute[72815]:       <mac address="fa:16:3e:9a:ea:b9"/>
Aug 17 20:08:46 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:08:46 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:08:46 user nova-compute[72815]:       <target dev="tapb891ebda-fc"/>
Aug 17 20:08:46 user nova-compute[72815]:     </interface>
Aug 17 20:08:46 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:08:46 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/console.log" append="off"/>
Aug 17 20:08:46 user nova-compute[72815]:     </serial>
Aug 17 20:08:46 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:08:46 user nova-compute[72815]:     <video>
Aug 17 20:08:46 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:08:46 user nova-compute[72815]:     </video>
Aug 17 20:08:46 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:08:46 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:08:46 user nova-compute[72815]:     </rng>
Aug 17 20:08:46 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:08:46 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:08:46 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:08:46 user nova-compute[72815]:     </memballoon>
Aug 17 20:08:46 user nova-compute[72815]:   </devices>
Aug 17 20:08:46 user nova-compute[72815]: </domain>
Aug 17 20:08:46 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-981235990',display_name='tempest-ServersNegativeTestJSON-server-981235990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-981235990',id=36,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d68603e63804620b9bacd300d254000',ramdisk_id='',reservation_id='r-c0fbep2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-128301023',owner_user_name='tempest-ServersNegativeTestJSON-128301023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:08:44Z,user_data=None,user_id='1c18f1cf89be4c63a7ad48ec390c6213',uuid=690ec89d-7800-4062-a912-7b7d38474b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "address": "fa:16:3e:9a:ea:b9", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb891ebda-fc", "ovs_interfaceid": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Converting VIF {"id": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "address": "fa:16:3e:9a:ea:b9", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb891ebda-fc", "ovs_interfaceid": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=b891ebda-fc59-46c7-be66-25ab4446c7c1,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb891ebda-fc') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG os_vif [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=b891ebda-fc59-46c7-be66-25ab4446c7c1,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb891ebda-fc') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb891ebda-fc, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb891ebda-fc, col_values=(('external_ids', {'iface-id': 'b891ebda-fc59-46c7-be66-25ab4446c7c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:ea:b9', 'vm-uuid': '690ec89d-7800-4062-a912-7b7d38474b59'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:46 user nova-compute[72815]: INFO os_vif [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=b891ebda-fc59-46c7-be66-25ab4446c7c1,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb891ebda-fc')
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:08:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] No VIF found with MAC fa:16:3e:9a:ea:b9, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:08:47 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0c16cd3d-e6c1-4558-8b20-0202030fac69 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Updating instance_info_cache with network_info: [{"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:08:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0c16cd3d-e6c1-4558-8b20-0202030fac69 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Releasing lock "refresh_cache-caffa446-5b29-4c5d-b756-4cc7119676cf" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:08:47 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0c16cd3d-e6c1-4558-8b20-0202030fac69 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'flavor' on Instance uuid caffa446-5b29-4c5d-b756-4cc7119676cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:08:47 user nova-compute[72815]: DEBUG nova.network.neutron [req-296aec56-8555-479b-b759-331192880cb5 req-2648f005-fbad-4fb0-b0c9-3ab067d64ec5 service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Updated VIF entry in instance network info cache for port b891ebda-fc59-46c7-be66-25ab4446c7c1. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:08:47 user nova-compute[72815]: DEBUG nova.network.neutron [req-296aec56-8555-479b-b759-331192880cb5 req-2648f005-fbad-4fb0-b0c9-3ab067d64ec5 service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Updating instance_info_cache with network_info: [{"id": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "address": "fa:16:3e:9a:ea:b9", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb891ebda-fc", "ovs_interfaceid": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:08:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-296aec56-8555-479b-b759-331192880cb5 req-2648f005-fbad-4fb0-b0c9-3ab067d64ec5 service nova] Releasing lock "refresh_cache-690ec89d-7800-4062-a912-7b7d38474b59" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:08:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-5a354003-3531-4f52-ad33-0834b9a41daf req-5d058c27-b010-498f-98ff-06aafbcb1d0e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-unplugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5a354003-3531-4f52-ad33-0834b9a41daf req-5d058c27-b010-498f-98ff-06aafbcb1d0e service nova] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5a354003-3531-4f52-ad33-0834b9a41daf req-5d058c27-b010-498f-98ff-06aafbcb1d0e service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5a354003-3531-4f52-ad33-0834b9a41daf req-5d058c27-b010-498f-98ff-06aafbcb1d0e service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-5a354003-3531-4f52-ad33-0834b9a41daf req-5d058c27-b010-498f-98ff-06aafbcb1d0e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] No waiting events found dispatching network-vif-unplugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:08:48 user nova-compute[72815]: WARNING nova.compute.manager [req-5a354003-3531-4f52-ad33-0834b9a41daf req-5d058c27-b010-498f-98ff-06aafbcb1d0e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received unexpected event network-vif-unplugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 for instance with vm_state rescued and task_state unrescuing.
Aug 17 20:08:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-5a354003-3531-4f52-ad33-0834b9a41daf req-5d058c27-b010-498f-98ff-06aafbcb1d0e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5a354003-3531-4f52-ad33-0834b9a41daf req-5d058c27-b010-498f-98ff-06aafbcb1d0e service nova] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5a354003-3531-4f52-ad33-0834b9a41daf req-5d058c27-b010-498f-98ff-06aafbcb1d0e service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5a354003-3531-4f52-ad33-0834b9a41daf req-5d058c27-b010-498f-98ff-06aafbcb1d0e service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-5a354003-3531-4f52-ad33-0834b9a41daf req-5d058c27-b010-498f-98ff-06aafbcb1d0e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] No waiting events found dispatching network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:08:48 user nova-compute[72815]: WARNING nova.compute.manager [req-5a354003-3531-4f52-ad33-0834b9a41daf req-5d058c27-b010-498f-98ff-06aafbcb1d0e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received unexpected event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 for instance with vm_state rescued and task_state unrescuing.
Aug 17 20:08:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Instance destroyed successfully.
Aug 17 20:08:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-595a37b7-871f-43d8-884b-f2903b5227e2 req-522a6a94-6ee8-4064-a130-3128193de87a service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Received event network-vif-plugged-b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-595a37b7-871f-43d8-884b-f2903b5227e2 req-522a6a94-6ee8-4064-a130-3128193de87a service nova] Acquiring lock "690ec89d-7800-4062-a912-7b7d38474b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-595a37b7-871f-43d8-884b-f2903b5227e2 req-522a6a94-6ee8-4064-a130-3128193de87a service nova] Lock "690ec89d-7800-4062-a912-7b7d38474b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-595a37b7-871f-43d8-884b-f2903b5227e2 req-522a6a94-6ee8-4064-a130-3128193de87a service nova] Lock "690ec89d-7800-4062-a912-7b7d38474b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-595a37b7-871f-43d8-884b-f2903b5227e2 req-522a6a94-6ee8-4064-a130-3128193de87a service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] No waiting events found dispatching network-vif-plugged-b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:08:48 user nova-compute[72815]: WARNING nova.compute.manager [req-595a37b7-871f-43d8-884b-f2903b5227e2 req-522a6a94-6ee8-4064-a130-3128193de87a service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Received unexpected event network-vif-plugged-b891ebda-fc59-46c7-be66-25ab4446c7c1 for instance with vm_state building and task_state spawning.
Aug 17 20:08:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-8d562bcd-7c84-4956-b834-12f42492657a req-6f304c1b-4b2f-41ee-a8fa-fb3ca1594c73 service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8d562bcd-7c84-4956-b834-12f42492657a req-6f304c1b-4b2f-41ee-a8fa-fb3ca1594c73 service nova] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8d562bcd-7c84-4956-b834-12f42492657a req-6f304c1b-4b2f-41ee-a8fa-fb3ca1594c73 service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8d562bcd-7c84-4956-b834-12f42492657a req-6f304c1b-4b2f-41ee-a8fa-fb3ca1594c73 service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-8d562bcd-7c84-4956-b834-12f42492657a req-6f304c1b-4b2f-41ee-a8fa-fb3ca1594c73 service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] No waiting events found dispatching network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:08:50 user nova-compute[72815]: WARNING nova.compute.manager [req-8d562bcd-7c84-4956-b834-12f42492657a req-6f304c1b-4b2f-41ee-a8fa-fb3ca1594c73 service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received unexpected event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 for instance with vm_state rescued and task_state unrescuing.
Aug 17 20:08:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-9425b079-5f21-4390-a925-9003e377ca6b req-5307fb42-62f7-46ab-8d42-61882b652f46 service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Received event network-vif-plugged-b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9425b079-5f21-4390-a925-9003e377ca6b req-5307fb42-62f7-46ab-8d42-61882b652f46 service nova] Acquiring lock "690ec89d-7800-4062-a912-7b7d38474b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9425b079-5f21-4390-a925-9003e377ca6b req-5307fb42-62f7-46ab-8d42-61882b652f46 service nova] Lock "690ec89d-7800-4062-a912-7b7d38474b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9425b079-5f21-4390-a925-9003e377ca6b req-5307fb42-62f7-46ab-8d42-61882b652f46 service nova] Lock "690ec89d-7800-4062-a912-7b7d38474b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-9425b079-5f21-4390-a925-9003e377ca6b req-5307fb42-62f7-46ab-8d42-61882b652f46 service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] No waiting events found dispatching network-vif-plugged-b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:08:50 user nova-compute[72815]: WARNING nova.compute.manager [req-9425b079-5f21-4390-a925-9003e377ca6b req-5307fb42-62f7-46ab-8d42-61882b652f46 service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Received unexpected event network-vif-plugged-b891ebda-fc59-46c7-be66-25ab4446c7c1 for instance with vm_state building and task_state spawning.
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302931.765576, 690ec89d-7800-4062-a912-7b7d38474b59 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:08:51 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] VM Resumed (Lifecycle Event)
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:08:51 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Instance spawned successfully.
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:08:51 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302931.7670045, 690ec89d-7800-4062-a912-7b7d38474b59 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:08:51 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] VM Started (Lifecycle Event)
Aug 17 20:08:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:08:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:08:51 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:08:51 user nova-compute[72815]: INFO nova.compute.manager [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Took 7.42 seconds to spawn the instance on the hypervisor.
Aug 17 20:08:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:08:51 user nova-compute[72815]: INFO nova.compute.manager [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Took 8.23 seconds to build instance.
Aug 17 20:08:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e63c85d6-657c-477f-b6aa-e480bcb811a9 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "690ec89d-7800-4062-a912-7b7d38474b59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.316s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for caffa446-5b29-4c5d-b756-4cc7119676cf due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 20:08:52 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302932.272124, caffa446-5b29-4c5d-b756-4cc7119676cf => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:08:52 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] VM Resumed (Lifecycle Event)
Aug 17 20:08:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0c16cd3d-e6c1-4558-8b20-0202030fac69 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:08:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:08:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:08:52 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 20:08:52 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302932.2768211, caffa446-5b29-4c5d-b756-4cc7119676cf => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:08:52 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] VM Started (Lifecycle Event)
Aug 17 20:08:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:08:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:08:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-7743514f-f85a-43c5-ac62-ec514f56ce70 req-9899a68c-3ab2-4af0-b17f-b7f920ea54a3 service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:08:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7743514f-f85a-43c5-ac62-ec514f56ce70 req-9899a68c-3ab2-4af0-b17f-b7f920ea54a3 service nova] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:08:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7743514f-f85a-43c5-ac62-ec514f56ce70 req-9899a68c-3ab2-4af0-b17f-b7f920ea54a3 service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:08:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7743514f-f85a-43c5-ac62-ec514f56ce70 req-9899a68c-3ab2-4af0-b17f-b7f920ea54a3 service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:08:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-7743514f-f85a-43c5-ac62-ec514f56ce70 req-9899a68c-3ab2-4af0-b17f-b7f920ea54a3 service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] No waiting events found dispatching network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:08:52 user nova-compute[72815]: WARNING nova.compute.manager [req-7743514f-f85a-43c5-ac62-ec514f56ce70 req-9899a68c-3ab2-4af0-b17f-b7f920ea54a3 service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received unexpected event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 for instance with vm_state active and task_state None.
Aug 17 20:08:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:08:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:09:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:09:01 user nova-compute[72815]: INFO nova.compute.claims [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Claim successful on node user
Aug 17 20:09:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Going to confirm migration 2 {{(pid=72815) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:09:02 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:09:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquired lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:09:02 user nova-compute[72815]: DEBUG nova.objects.instance [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'info_cache' on Instance uuid 4c630764-4e1b-4bab-b354-1389cd60f5a5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:09:02 user nova-compute[72815]: INFO nova.virt.block_device [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Booting with volume 6c793022-8723-4434-8a22-14cbc10656d6 at /dev/vda
Aug 17 20:09:02 user nova-compute[72815]: DEBUG nova.policy [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '577ed0692a254a2fbd518e258563447f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78ad2cbee8e4db892ab66d619e0e42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG os_brick.utils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb73693-6863-4ae0-aa80-377724094d8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae31b4b6-1e3f-4fc8-9402-6f78e22c3425]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[503dbb99-aa39-49a2-a1f1-e8e53865bb80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ec4d14-29f4-4c6a-b67f-ca714861f3ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:09:03 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf8de0e-5ae8-4f87-baf7-c64cef1c955b]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG os_brick.utils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Updating existing volume attachment record: e28f8cc4-5742-4def-b541-37644dbd917b {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updating instance_info_cache with network_info: [{"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Releasing lock "refresh_cache-4c630764-4e1b-4bab-b354-1389cd60f5a5" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG nova.objects.instance [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'migration_context' on Instance uuid 4c630764-4e1b-4bab-b354-1389cd60f5a5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Successfully created port: df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:09:04 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:09:04 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:09:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.742s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:04 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Deleted allocation for migration 65d0cdd3-5c78-4663-9138-7a4d52ef7045
Aug 17 20:09:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-df5f3f35-1612-4d7f-bdcd-66051e5c8914 tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.486s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:04 user nova-compute[72815]: DEBUG nova.network.neutron [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Successfully updated port: df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:09:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "refresh_cache-62614d4a-13bb-4c75-8f84-c47bdbf7b024" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:09:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquired lock "refresh_cache-62614d4a-13bb-4c75-8f84-c47bdbf7b024" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:09:04 user nova-compute[72815]: DEBUG nova.network.neutron [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:09:04 user nova-compute[72815]: DEBUG nova.network.neutron [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:09:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-8272e9da-11ca-4af9-b981-728fd9d6d952 req-82bd6658-7adb-46a4-93bb-640ac2f5e792 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Received event network-changed-df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:09:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-8272e9da-11ca-4af9-b981-728fd9d6d952 req-82bd6658-7adb-46a4-93bb-640ac2f5e792 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Refreshing instance network info cache due to event network-changed-df957619-7f8e-4b2a-9dc8-7d7be2d09c51. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:09:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8272e9da-11ca-4af9-b981-728fd9d6d952 req-82bd6658-7adb-46a4-93bb-640ac2f5e792 service nova] Acquiring lock "refresh_cache-62614d4a-13bb-4c75-8f84-c47bdbf7b024" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:09:05 user nova-compute[72815]: DEBUG nova.network.neutron [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Updating instance_info_cache with network_info: [{"id": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "address": "fa:16:3e:f6:fd:19", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf957619-7f", "ovs_interfaceid": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:09:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Releasing lock "refresh_cache-62614d4a-13bb-4c75-8f84-c47bdbf7b024" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:09:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Instance network_info: |[{"id": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "address": "fa:16:3e:f6:fd:19", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf957619-7f", "ovs_interfaceid": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:09:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8272e9da-11ca-4af9-b981-728fd9d6d952 req-82bd6658-7adb-46a4-93bb-640ac2f5e792 service nova] Acquired lock "refresh_cache-62614d4a-13bb-4c75-8f84-c47bdbf7b024" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:09:05 user nova-compute[72815]: DEBUG nova.network.neutron [req-8272e9da-11ca-4af9-b981-728fd9d6d952 req-82bd6658-7adb-46a4-93bb-640ac2f5e792 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Refreshing network info cache for port df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:09:05 user nova-compute[72815]: DEBUG nova.network.neutron [req-8272e9da-11ca-4af9-b981-728fd9d6d952 req-82bd6658-7adb-46a4-93bb-640ac2f5e792 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Updated VIF entry in instance network info cache for port df957619-7f8e-4b2a-9dc8-7d7be2d09c51. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:09:05 user nova-compute[72815]: DEBUG nova.network.neutron [req-8272e9da-11ca-4af9-b981-728fd9d6d952 req-82bd6658-7adb-46a4-93bb-640ac2f5e792 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Updating instance_info_cache with network_info: [{"id": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "address": "fa:16:3e:f6:fd:19", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf957619-7f", "ovs_interfaceid": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:09:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8272e9da-11ca-4af9-b981-728fd9d6d952 req-82bd6658-7adb-46a4-93bb-640ac2f5e792 service nova] Releasing lock "refresh_cache-62614d4a-13bb-4c75-8f84-c47bdbf7b024" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:09:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:09:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:09:14 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Creating image(s)
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Ensure instance console log exists: /opt/stack/data/nova/instances/62614d4a-13bb-4c75-8f84-c47bdbf7b024/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Start _get_guest_xml network_info=[{"id": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "address": "fa:16:3e:f6:fd:19", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf957619-7f", "ovs_interfaceid": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': 'e28f8cc4-5742-4def-b541-37644dbd917b', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGXFpHNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62614d4a-13bb-4c75-8f84-c47bdbf7b024', 'attached_at': '', 'detached_at': '', 'volume_id': '6c793022-8723-4434-8a22-14cbc10656d6', 'serial': '6c793022-8723-4434-8a22-14cbc10656d6'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:09:14 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:09:14 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGXFpHNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:09:14 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:09:14 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:09:14 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9241193b-1ecb-46ef-8661-eae91df913fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:09:14 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1f177a-9fa9-4152-9f42-fb729c58b48e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6] added
Aug 17 20:09:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a816bd02-07d8-4c0c-930b-93c1628927e5]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[279b5ff2-7eb3-4d60-ac96-29ef1262ad72]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGXFpHNY {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGXFpHNY" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[662fd36d-6d90-4245-bf57-8293d67569ea]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EGXFpHNY'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[84893323-1afe-425e-a791-3184ba3f85aa]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d120291e-012e-44b3-a956-d6384a8b2cf9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:09:14 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:09:14 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:09:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:09:14 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:09:14 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:09:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2220b98-a985-4008-b65e-1144f1edbf9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6, portal: 172.16.0.220,3260]
Aug 17 20:09:14 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6, portal: 172.16.0.220,3260] successful.
Aug 17 20:09:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f49381-f961-4dea-a58c-1cfa470d6a44]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ff6d6b-de97-48eb-8cf9-56b9e5598bc1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:09:15 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:09:15 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:09:15 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:09:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:09:15 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:09:15 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:09:15 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:09:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e088f9fe-630d-4bb2-b235-8797462ff025]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:09:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGXFpHNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23435303439366266', 'path': '/dev/sde'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435303439366266', 'path': '/dev/sde'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:09:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-38227440',display_name='tempest-TestVolumeBootPattern-volume-backed-server-38227440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-38227440',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvzRwv1NeLsV63rdqwUQ1Eb1s71WFYyUOsy8khx7tMsvFjliKuYCsvWkbFvTF9akzGWfw7QEm1dusQH1Hh6NyShCCeD+nyC9m4msHasFVue0J2EqIglq0Rxjs41bG9D/A==',key_name='tempest-keypair-1245356691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-6im7sz0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:09:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577ed0692a254a2fbd518e258563447f',uuid=62614d4a-13bb-4c75-8f84-c47bdbf7b024,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "address": "fa:16:3e:f6:fd:19", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf957619-7f", "ovs_interfaceid": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "address": "fa:16:3e:f6:fd:19", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf957619-7f", "ovs_interfaceid": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=df957619-7f8e-4b2a-9dc8-7d7be2d09c51,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf957619-7f') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG nova.objects.instance [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lazy-loading 'pci_devices' on Instance uuid 62614d4a-13bb-4c75-8f84-c47bdbf7b024 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:09:16 user nova-compute[72815]:   <uuid>62614d4a-13bb-4c75-8f84-c47bdbf7b024</uuid>
Aug 17 20:09:16 user nova-compute[72815]:   <name>instance-00000025</name>
Aug 17 20:09:16 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:09:16 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:09:16 user nova-compute[72815]:   <metadata>
Aug 17 20:09:16 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:09:16 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:09:16 user nova-compute[72815]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-38227440</nova:name>
Aug 17 20:09:16 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:09:14</nova:creationTime>
Aug 17 20:09:16 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:09:16 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:09:16 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:09:16 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:09:16 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:09:16 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:09:16 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:09:16 user nova-compute[72815]:       <nova:owner>
Aug 17 20:09:16 user nova-compute[72815]:         <nova:user uuid="577ed0692a254a2fbd518e258563447f">tempest-TestVolumeBootPattern-781314261-project-member</nova:user>
Aug 17 20:09:16 user nova-compute[72815]:         <nova:project uuid="a78ad2cbee8e4db892ab66d619e0e42e">tempest-TestVolumeBootPattern-781314261</nova:project>
Aug 17 20:09:16 user nova-compute[72815]:       </nova:owner>
Aug 17 20:09:16 user nova-compute[72815]:       <nova:ports>
Aug 17 20:09:16 user nova-compute[72815]:         <nova:port uuid="df957619-7f8e-4b2a-9dc8-7d7be2d09c51">
Aug 17 20:09:16 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 20:09:16 user nova-compute[72815]:         </nova:port>
Aug 17 20:09:16 user nova-compute[72815]:       </nova:ports>
Aug 17 20:09:16 user nova-compute[72815]:     </nova:instance>
Aug 17 20:09:16 user nova-compute[72815]:   </metadata>
Aug 17 20:09:16 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:09:16 user nova-compute[72815]:     <system>
Aug 17 20:09:16 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:09:16 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:09:16 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:09:16 user nova-compute[72815]:       <entry name="serial">62614d4a-13bb-4c75-8f84-c47bdbf7b024</entry>
Aug 17 20:09:16 user nova-compute[72815]:       <entry name="uuid">62614d4a-13bb-4c75-8f84-c47bdbf7b024</entry>
Aug 17 20:09:16 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:09:16 user nova-compute[72815]:     </system>
Aug 17 20:09:16 user nova-compute[72815]:   </sysinfo>
Aug 17 20:09:16 user nova-compute[72815]:   <os>
Aug 17 20:09:16 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:09:16 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:09:16 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:09:16 user nova-compute[72815]:   </os>
Aug 17 20:09:16 user nova-compute[72815]:   <features>
Aug 17 20:09:16 user nova-compute[72815]:     <acpi/>
Aug 17 20:09:16 user nova-compute[72815]:     <apic/>
Aug 17 20:09:16 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:09:16 user nova-compute[72815]:   </features>
Aug 17 20:09:16 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:09:16 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:09:16 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:09:16 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:09:16 user nova-compute[72815]:   </clock>
Aug 17 20:09:16 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:09:16 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:09:16 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:09:16 user nova-compute[72815]:   </cpu>
Aug 17 20:09:16 user nova-compute[72815]:   <devices>
Aug 17 20:09:16 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:09:16 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:09:16 user nova-compute[72815]:       <source dev="/dev/sde"/>
Aug 17 20:09:16 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:09:16 user nova-compute[72815]:       <serial>6c793022-8723-4434-8a22-14cbc10656d6</serial>
Aug 17 20:09:16 user nova-compute[72815]:     </disk>
Aug 17 20:09:16 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:09:16 user nova-compute[72815]:       <mac address="fa:16:3e:f6:fd:19"/>
Aug 17 20:09:16 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:09:16 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:09:16 user nova-compute[72815]:       <target dev="tapdf957619-7f"/>
Aug 17 20:09:16 user nova-compute[72815]:     </interface>
Aug 17 20:09:16 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:09:16 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/62614d4a-13bb-4c75-8f84-c47bdbf7b024/console.log" append="off"/>
Aug 17 20:09:16 user nova-compute[72815]:     </serial>
Aug 17 20:09:16 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:09:16 user nova-compute[72815]:     <video>
Aug 17 20:09:16 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:09:16 user nova-compute[72815]:     </video>
Aug 17 20:09:16 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:09:16 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:09:16 user nova-compute[72815]:     </rng>
Aug 17 20:09:16 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:09:16 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:09:16 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:09:16 user nova-compute[72815]:     </memballoon>
Aug 17 20:09:16 user nova-compute[72815]:   </devices>
Aug 17 20:09:16 user nova-compute[72815]: </domain>
Aug 17 20:09:16 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:09:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-38227440',display_name='tempest-TestVolumeBootPattern-volume-backed-server-38227440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-38227440',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvzRwv1NeLsV63rdqwUQ1Eb1s71WFYyUOsy8khx7tMsvFjliKuYCsvWkbFvTF9akzGWfw7QEm1dusQH1Hh6NyShCCeD+nyC9m4msHasFVue0J2EqIglq0Rxjs41bG9D/A==',key_name='tempest-keypair-1245356691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-6im7sz0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:09:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577ed0692a254a2fbd518e258563447f',uuid=62614d4a-13bb-4c75-8f84-c47bdbf7b024,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "address": "fa:16:3e:f6:fd:19", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf957619-7f", "ovs_interfaceid": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "address": "fa:16:3e:f6:fd:19", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf957619-7f", "ovs_interfaceid": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=df957619-7f8e-4b2a-9dc8-7d7be2d09c51,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf957619-7f') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG os_vif [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=df957619-7f8e-4b2a-9dc8-7d7be2d09c51,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf957619-7f') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf957619-7f, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf957619-7f, col_values=(('external_ids', {'iface-id': 'df957619-7f8e-4b2a-9dc8-7d7be2d09c51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:fd:19', 'vm-uuid': '62614d4a-13bb-4c75-8f84-c47bdbf7b024'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:16 user nova-compute[72815]: INFO os_vif [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=df957619-7f8e-4b2a-9dc8-7d7be2d09c51,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf957619-7f')
Aug 17 20:09:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] No VIF found with MAC fa:16:3e:f6:fd:19, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:09:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-539e023e-f1a0-4f74-b04b-da0522a80757 req-04228b1b-c5a4-41ec-b4f3-e331962c52fb service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Received event network-vif-plugged-df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:09:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-539e023e-f1a0-4f74-b04b-da0522a80757 req-04228b1b-c5a4-41ec-b4f3-e331962c52fb service nova] Acquiring lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-539e023e-f1a0-4f74-b04b-da0522a80757 req-04228b1b-c5a4-41ec-b4f3-e331962c52fb service nova] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-539e023e-f1a0-4f74-b04b-da0522a80757 req-04228b1b-c5a4-41ec-b4f3-e331962c52fb service nova] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-539e023e-f1a0-4f74-b04b-da0522a80757 req-04228b1b-c5a4-41ec-b4f3-e331962c52fb service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] No waiting events found dispatching network-vif-plugged-df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:09:17 user nova-compute[72815]: WARNING nova.compute.manager [req-539e023e-f1a0-4f74-b04b-da0522a80757 req-04228b1b-c5a4-41ec-b4f3-e331962c52fb service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Received unexpected event network-vif-plugged-df957619-7f8e-4b2a-9dc8-7d7be2d09c51 for instance with vm_state building and task_state spawning.
Aug 17 20:09:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.compute.manager [req-f3e7e71a-01db-49f1-a217-f1c2e35bba45 req-c18d2715-f67c-4c6a-8c1f-77dd488899cf service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Received event network-vif-plugged-df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f3e7e71a-01db-49f1-a217-f1c2e35bba45 req-c18d2715-f67c-4c6a-8c1f-77dd488899cf service nova] Acquiring lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f3e7e71a-01db-49f1-a217-f1c2e35bba45 req-c18d2715-f67c-4c6a-8c1f-77dd488899cf service nova] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f3e7e71a-01db-49f1-a217-f1c2e35bba45 req-c18d2715-f67c-4c6a-8c1f-77dd488899cf service nova] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.compute.manager [req-f3e7e71a-01db-49f1-a217-f1c2e35bba45 req-c18d2715-f67c-4c6a-8c1f-77dd488899cf service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] No waiting events found dispatching network-vif-plugged-df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:09:19 user nova-compute[72815]: WARNING nova.compute.manager [req-f3e7e71a-01db-49f1-a217-f1c2e35bba45 req-c18d2715-f67c-4c6a-8c1f-77dd488899cf service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Received unexpected event network-vif-plugged-df957619-7f8e-4b2a-9dc8-7d7be2d09c51 for instance with vm_state building and task_state spawning.
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302959.8066196, 62614d4a-13bb-4c75-8f84-c47bdbf7b024 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:09:19 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] VM Resumed (Lifecycle Event)
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:09:19 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Instance spawned successfully.
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:09:19 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692302959.8081925, 62614d4a-13bb-4c75-8f84-c47bdbf7b024 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:09:19 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] VM Started (Lifecycle Event)
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:09:19 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:09:19 user nova-compute[72815]: INFO nova.compute.manager [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Took 5.39 seconds to spawn the instance on the hypervisor.
Aug 17 20:09:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:09:20 user nova-compute[72815]: INFO nova.compute.manager [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Took 18.45 seconds to build instance.
Aug 17 20:09:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aaea5640-780c-4336-b62a-21686e915eaa tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.694s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:20 user nova-compute[72815]: INFO nova.compute.manager [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Terminating instance
Aug 17 20:09:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:09:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:21 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Instance destroyed successfully.
Aug 17 20:09:21 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'resources' on Instance uuid 72c9428f-f797-46b4-9780-d2a4abb01ae7 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-857873287',display_name='tempest-AttachVolumeNegativeTest-server-857873287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-857873287',id=25,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUyELm0xEBtJuFozQY4UX3vPr3efF6Imhcj1qxiDC/pA+gqxrHbYk3vvgTNi17YRu9YiDg+Qrau4mlrCgRG0FjBMB+vy8aZVbjgiE0u0p4xkBxnWmhMO01H7oTiWPCRuA==',key_name='tempest-keypair-1747713663',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ee9b4cae7404f3184fc480ffddfbbcd',ramdisk_id='',reservation_id='r-lm6171z3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1950293532',owner_user_name='tempest-AttachVolumeNegativeTest-1950293532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a75e05392d54cfb9fcda786e3ee2efc',uuid=72c9428f-f797-46b4-9780-d2a4abb01ae7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "address": "fa:16:3e:ba:2a:d7", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbd6c4-08", "ovs_interfaceid": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converting VIF {"id": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "address": "fa:16:3e:ba:2a:d7", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbd6c4-08", "ovs_interfaceid": "28cbd6c4-08ff-4d40-ac71-f26a0b61457d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:2a:d7,bridge_name='br-int',has_traffic_filtering=True,id=28cbd6c4-08ff-4d40-ac71-f26a0b61457d,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbd6c4-08') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG os_vif [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:2a:d7,bridge_name='br-int',has_traffic_filtering=True,id=28cbd6c4-08ff-4d40-ac71-f26a0b61457d,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbd6c4-08') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28cbd6c4-08, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:09:21 user nova-compute[72815]: INFO os_vif [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:2a:d7,bridge_name='br-int',has_traffic_filtering=True,id=28cbd6c4-08ff-4d40-ac71-f26a0b61457d,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbd6c4-08')
Aug 17 20:09:21 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Deleting instance files /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7_del
Aug 17 20:09:21 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Deletion of /opt/stack/data/nova/instances/72c9428f-f797-46b4-9780-d2a4abb01ae7_del complete
Aug 17 20:09:21 user nova-compute[72815]: INFO nova.compute.manager [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 17 20:09:21 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-2aaadd1c-7d60-4a58-a439-2fc8faddfad4 req-d999bde0-9e6b-4f24-8a4c-725fc125b90e service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Received event network-vif-unplugged-28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2aaadd1c-7d60-4a58-a439-2fc8faddfad4 req-d999bde0-9e6b-4f24-8a4c-725fc125b90e service nova] Acquiring lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2aaadd1c-7d60-4a58-a439-2fc8faddfad4 req-d999bde0-9e6b-4f24-8a4c-725fc125b90e service nova] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2aaadd1c-7d60-4a58-a439-2fc8faddfad4 req-d999bde0-9e6b-4f24-8a4c-725fc125b90e service nova] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-2aaadd1c-7d60-4a58-a439-2fc8faddfad4 req-d999bde0-9e6b-4f24-8a4c-725fc125b90e service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] No waiting events found dispatching network-vif-unplugged-28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-2aaadd1c-7d60-4a58-a439-2fc8faddfad4 req-d999bde0-9e6b-4f24-8a4c-725fc125b90e service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Received event network-vif-unplugged-28cbd6c4-08ff-4d40-ac71-f26a0b61457d for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-2aaadd1c-7d60-4a58-a439-2fc8faddfad4 req-d999bde0-9e6b-4f24-8a4c-725fc125b90e service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Received event network-vif-plugged-28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2aaadd1c-7d60-4a58-a439-2fc8faddfad4 req-d999bde0-9e6b-4f24-8a4c-725fc125b90e service nova] Acquiring lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2aaadd1c-7d60-4a58-a439-2fc8faddfad4 req-d999bde0-9e6b-4f24-8a4c-725fc125b90e service nova] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2aaadd1c-7d60-4a58-a439-2fc8faddfad4 req-d999bde0-9e6b-4f24-8a4c-725fc125b90e service nova] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-2aaadd1c-7d60-4a58-a439-2fc8faddfad4 req-d999bde0-9e6b-4f24-8a4c-725fc125b90e service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] No waiting events found dispatching network-vif-plugged-28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:09:21 user nova-compute[72815]: WARNING nova.compute.manager [req-2aaadd1c-7d60-4a58-a439-2fc8faddfad4 req-d999bde0-9e6b-4f24-8a4c-725fc125b90e service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Received unexpected event network-vif-plugged-28cbd6c4-08ff-4d40-ac71-f26a0b61457d for instance with vm_state active and task_state deleting.
Aug 17 20:09:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:21 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:09:22 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Took 0.86 seconds to deallocate network for instance.
Aug 17 20:09:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-8c21b502-8e71-4968-b5ed-be5c1e278649 req-e43aa6e6-97ba-4b1d-8c28-0e104fdf80c3 service nova] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Received event network-vif-deleted-28cbd6c4-08ff-4d40-ac71-f26a0b61457d {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:09:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:22 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:09:22 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:09:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.547s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:22 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Deleted allocations for instance 72c9428f-f797-46b4-9780-d2a4abb01ae7
Aug 17 20:09:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0628103f-8ef5-4d24-8ddf-592ab4a3a0a2 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "72c9428f-f797-46b4-9780-d2a4abb01ae7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.602s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Acquiring lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Acquiring lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:28 user nova-compute[72815]: INFO nova.compute.manager [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Terminating instance
Aug 17 20:09:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:09:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG nova.compute.manager [req-101de061-e5ef-471d-bd4d-bfb7bed8fbd1 req-a7dc9766-6f8c-47c4-aa38-411db732d25b service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Received event network-vif-unplugged-16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-101de061-e5ef-471d-bd4d-bfb7bed8fbd1 req-a7dc9766-6f8c-47c4-aa38-411db732d25b service nova] Acquiring lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-101de061-e5ef-471d-bd4d-bfb7bed8fbd1 req-a7dc9766-6f8c-47c4-aa38-411db732d25b service nova] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-101de061-e5ef-471d-bd4d-bfb7bed8fbd1 req-a7dc9766-6f8c-47c4-aa38-411db732d25b service nova] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG nova.compute.manager [req-101de061-e5ef-471d-bd4d-bfb7bed8fbd1 req-a7dc9766-6f8c-47c4-aa38-411db732d25b service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] No waiting events found dispatching network-vif-unplugged-16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG nova.compute.manager [req-101de061-e5ef-471d-bd4d-bfb7bed8fbd1 req-a7dc9766-6f8c-47c4-aa38-411db732d25b service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Received event network-vif-unplugged-16a8d1d7-b13a-4e80-906a-89a504b2e10a for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:09:29 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Instance destroyed successfully.
Aug 17 20:09:29 user nova-compute[72815]: DEBUG nova.objects.instance [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lazy-loading 'resources' on Instance uuid 3640f710-270a-48d4-9ae6-ffe7780d5bc8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1338658228',display_name='tempest-VolumesNegativeTest-instance-1338658228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1338658228',id=33,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:07:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aba22a2e532a42f9bf4d23a301a99af0',ramdisk_id='',reservation_id='r-hdpayyk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-838376008',owner_user_name='tempest-VolumesNegativeTest-838376008-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:07:47Z,user_data=None,user_id='d64919c88ba4427caa388105aaf0c68a',uuid=3640f710-270a-48d4-9ae6-ffe7780d5bc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "address": "fa:16:3e:77:df:e3", "network": {"id": "0d489fdb-4617-407d-8181-205ba807ec6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a9954624a59348f3ab4e9691dd6f1b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d1d7-b1", "ovs_interfaceid": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Converting VIF {"id": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "address": "fa:16:3e:77:df:e3", "network": {"id": "0d489fdb-4617-407d-8181-205ba807ec6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a9954624a59348f3ab4e9691dd6f1b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d1d7-b1", "ovs_interfaceid": "16a8d1d7-b13a-4e80-906a-89a504b2e10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:df:e3,bridge_name='br-int',has_traffic_filtering=True,id=16a8d1d7-b13a-4e80-906a-89a504b2e10a,network=Network(0d489fdb-4617-407d-8181-205ba807ec6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d1d7-b1') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG os_vif [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:df:e3,bridge_name='br-int',has_traffic_filtering=True,id=16a8d1d7-b13a-4e80-906a-89a504b2e10a,network=Network(0d489fdb-4617-407d-8181-205ba807ec6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d1d7-b1') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16a8d1d7-b1, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:09:29 user nova-compute[72815]: INFO os_vif [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:df:e3,bridge_name='br-int',has_traffic_filtering=True,id=16a8d1d7-b13a-4e80-906a-89a504b2e10a,network=Network(0d489fdb-4617-407d-8181-205ba807ec6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d1d7-b1')
Aug 17 20:09:29 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Deleting instance files /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8_del
Aug 17 20:09:29 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Deletion of /opt/stack/data/nova/instances/3640f710-270a-48d4-9ae6-ffe7780d5bc8_del complete
Aug 17 20:09:29 user nova-compute[72815]: INFO nova.compute.manager [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 20:09:29 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:09:29 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:30 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:09:30 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Took 1.14 seconds to deallocate network for instance.
Aug 17 20:09:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-ac12efd9-17cd-4520-8003-95f27e6e356c req-dc0e39f7-8265-428c-b705-552ff07eaf46 service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Received event network-vif-deleted-16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:09:30 user nova-compute[72815]: INFO nova.compute.manager [req-ac12efd9-17cd-4520-8003-95f27e6e356c req-dc0e39f7-8265-428c-b705-552ff07eaf46 service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Neutron deleted interface 16a8d1d7-b13a-4e80-906a-89a504b2e10a; detaching it from the instance and deleting it from the info cache
Aug 17 20:09:30 user nova-compute[72815]: DEBUG nova.network.neutron [req-ac12efd9-17cd-4520-8003-95f27e6e356c req-dc0e39f7-8265-428c-b705-552ff07eaf46 service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:09:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-ac12efd9-17cd-4520-8003-95f27e6e356c req-dc0e39f7-8265-428c-b705-552ff07eaf46 service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Detach interface failed, port_id=16a8d1d7-b13a-4e80-906a-89a504b2e10a, reason: Instance 3640f710-270a-48d4-9ae6-ffe7780d5bc8 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:09:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-55fc3740-52ab-43dd-a38e-d19d0b4e2866 req-3d4f939f-894a-4318-b737-8c85a2e07689 service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Received event network-vif-plugged-16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:09:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-55fc3740-52ab-43dd-a38e-d19d0b4e2866 req-3d4f939f-894a-4318-b737-8c85a2e07689 service nova] Acquiring lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-55fc3740-52ab-43dd-a38e-d19d0b4e2866 req-3d4f939f-894a-4318-b737-8c85a2e07689 service nova] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-55fc3740-52ab-43dd-a38e-d19d0b4e2866 req-3d4f939f-894a-4318-b737-8c85a2e07689 service nova] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-55fc3740-52ab-43dd-a38e-d19d0b4e2866 req-3d4f939f-894a-4318-b737-8c85a2e07689 service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] No waiting events found dispatching network-vif-plugged-16a8d1d7-b13a-4e80-906a-89a504b2e10a {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:09:31 user nova-compute[72815]: WARNING nova.compute.manager [req-55fc3740-52ab-43dd-a38e-d19d0b4e2866 req-3d4f939f-894a-4318-b737-8c85a2e07689 service nova] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Received unexpected event network-vif-plugged-16a8d1d7-b13a-4e80-906a-89a504b2e10a for instance with vm_state deleted and task_state None.
Aug 17 20:09:31 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:09:31 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:09:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:31 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Deleted allocations for instance 3640f710-270a-48d4-9ae6-ffe7780d5bc8
Aug 17 20:09:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-af2d08f1-5185-4488-a574-9ff82bee4703 tempest-VolumesNegativeTest-838376008 tempest-VolumesNegativeTest-838376008-project-member] Lock "3640f710-270a-48d4-9ae6-ffe7780d5bc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.728s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:31 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-f979e3d3-0b4f-4672-91a9-8a27f1a58251 req-2876b661-168e-41b1-b9bd-b5ef0ebbcfc2 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Received event network-changed-1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG nova.compute.manager [req-f979e3d3-0b4f-4672-91a9-8a27f1a58251 req-2876b661-168e-41b1-b9bd-b5ef0ebbcfc2 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Refreshing instance network info cache due to event network-changed-1fdf5978-653e-4453-afdf-8d9cfc420666. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f979e3d3-0b4f-4672-91a9-8a27f1a58251 req-2876b661-168e-41b1-b9bd-b5ef0ebbcfc2 service nova] Acquiring lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f979e3d3-0b4f-4672-91a9-8a27f1a58251 req-2876b661-168e-41b1-b9bd-b5ef0ebbcfc2 service nova] Acquired lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG nova.network.neutron [req-f979e3d3-0b4f-4672-91a9-8a27f1a58251 req-2876b661-168e-41b1-b9bd-b5ef0ebbcfc2 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Refreshing network info cache for port 1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG nova.network.neutron [req-f979e3d3-0b4f-4672-91a9-8a27f1a58251 req-2876b661-168e-41b1-b9bd-b5ef0ebbcfc2 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updated VIF entry in instance network info cache for port 1fdf5978-653e-4453-afdf-8d9cfc420666. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG nova.network.neutron [req-f979e3d3-0b4f-4672-91a9-8a27f1a58251 req-2876b661-168e-41b1-b9bd-b5ef0ebbcfc2 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updating instance_info_cache with network_info: [{"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:09:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f979e3d3-0b4f-4672-91a9-8a27f1a58251 req-2876b661-168e-41b1-b9bd-b5ef0ebbcfc2 service nova] Releasing lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:09:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:09:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:09:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:36 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302961.0300117, 72c9428f-f797-46b4-9780-d2a4abb01ae7 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:09:36 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] VM Stopped (Lifecycle Event)
Aug 17 20:09:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-9a4a73c4-5064-4d5b-95a9-09bf2dcb4e4c None None] [instance: 72c9428f-f797-46b4-9780-d2a4abb01ae7] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:09:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'flavor' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:37 user nova-compute[72815]: INFO nova.compute.manager [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Attaching volume 30a7c14a-c4bd-4bdd-9f88-3d259f92b215 to /dev/vdb
Aug 17 20:09:37 user nova-compute[72815]: DEBUG os_brick.utils [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[43baa225-1a68-4e33-9ccf-f5f4bdfd3dbb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c4c637-dcd2-41d7-8831-0c7875bc886f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.067s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe55b64-e02f-4b9e-acf6-38852ef52153]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e365decd-fa6b-405e-ad83-19ba7a3dfd0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:09:37 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b479e5c9-3706-4398-a2ea-a4d27e1be0c1]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG os_brick.utils [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] <== get_connector_properties: return (213ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updating existing volume attachment record: 44f3e52a-1daf-49fb-a9a4-4abc8bb34071 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:09:38 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:09:38 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:09:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=6824MB free_disk=25.156723022460938GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:09:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 12a34846-1670-4c6c-ac7d-522530aaf3a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance caffa446-5b29-4c5d-b756-4cc7119676cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 8ac64ac9-a49d-4c70-956b-3a140da5ede8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 4c630764-4e1b-4bab-b354-1389cd60f5a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 99693a7e-71e3-4543-b649-41a147c77c7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance e7e09061-f65f-444b-98f6-409da28295e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 690ec89d-7800-4062-a912-7b7d38474b59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 62614d4a-13bb-4c75-8f84-c47bdbf7b024 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Refreshing inventories for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Updating ProviderTree inventory for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Updating inventory in ProviderTree for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Refreshing aggregate associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, aggregates: None {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Refreshing trait associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:09:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.869s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:09:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:09:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:09:40 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:09:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updating instance_info_cache with network_info: [{"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:09:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-ab784398-43df-4214-bdd3-22c652ac710f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:09:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:09:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:09:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 20:09:44 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692302969.6943498, 3640f710-270a-48d4-9ae6-ffe7780d5bc8 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:09:44 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] VM Stopped (Lifecycle Event)
Aug 17 20:09:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-337c999c-aba4-4196-acb4-3f33bae904b4 None None] [instance: 3640f710-270a-48d4-9ae6-ffe7780d5bc8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:09:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:45 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:09:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 20:09:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] There are 0 instances to clean {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 20:09:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LaBPgUGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:09:49 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:09:49 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:09:49 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbe4961-be08-431e-b646-75998b8cc23f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:09:49 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c9a73e-2402-4a78-ad65-ecdb2e0230c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215] added
Aug 17 20:09:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[46716007-e42a-4428-aa8d-6a6219fa40e7]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb406db-bb47-42c7-a417-cb8cb1e5e5ae]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LaBPgUGe {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LaBPgUGe" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[694e3638-37fc-49a1-9427-4bdd372ab5c6]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LaBPgUGe'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b92945a-125e-4621-b650-c76e658f9d20]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76ad83b-3ffa-466f-87a7-eb0a2ca854e7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --login" returned: 0 in 0.120s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee8f02e-3732-4205-8ef3-ac12841b56f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215, portal: 172.16.0.220,3260]
Aug 17 20:09:49 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215, portal: 172.16.0.220,3260] successful.
Aug 17 20:09:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[653efdab-aa7f-4185-a3b2-a5062ea0794f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de53bfd-5f61-460c-8cc6-65e83cfa7e74]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 (non-flash)
Aug 17 20:09:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c871640-a6ad-4cfc-8be2-3417b070861c]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LaBPgUGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:09:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:09:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26436323064663334', 'path': '/dev/sdf'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:09:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436323064663334', 'path': '/dev/sdf'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:09:50 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'flavor' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:09:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:09:50 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:09:50 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 20:09:50 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:09:50 user nova-compute[72815]:   <serial>30a7c14a-c4bd-4bdd-9f88-3d259f92b215</serial>
Aug 17 20:09:50 user nova-compute[72815]: </disk>
Aug 17 20:09:50 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] No VIF found with MAC fa:16:3e:29:77:f9, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f1cf52b2-d0f2-4632-82cb-2c82103afc63 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.861s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG nova.compute.manager [req-49915d8d-fecc-4f3a-a3c5-74ca7d8e0d06 req-eb55eeb3-b23b-45b5-b15a-2f9cac560713 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-changed-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG nova.compute.manager [req-49915d8d-fecc-4f3a-a3c5-74ca7d8e0d06 req-eb55eeb3-b23b-45b5-b15a-2f9cac560713 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Refreshing instance network info cache due to event network-changed-7a6d3944-52f6-4ffc-81d1-f648b2b44f59. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-49915d8d-fecc-4f3a-a3c5-74ca7d8e0d06 req-eb55eeb3-b23b-45b5-b15a-2f9cac560713 service nova] Acquiring lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-49915d8d-fecc-4f3a-a3c5-74ca7d8e0d06 req-eb55eeb3-b23b-45b5-b15a-2f9cac560713 service nova] Acquired lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG nova.network.neutron [req-49915d8d-fecc-4f3a-a3c5-74ca7d8e0d06 req-eb55eeb3-b23b-45b5-b15a-2f9cac560713 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Refreshing network info cache for port 7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "e7e09061-f65f-444b-98f6-409da28295e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:51 user nova-compute[72815]: DEBUG nova.objects.instance [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'flavor' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "e7e09061-f65f-444b-98f6-409da28295e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "e7e09061-f65f-444b-98f6-409da28295e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:52 user nova-compute[72815]: INFO nova.compute.manager [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Attaching volume 90e87f12-c09a-49cc-9b20-74249135b21f to /dev/vdb
Aug 17 20:09:52 user nova-compute[72815]: DEBUG os_brick.utils [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10dff0c-0175-4a5a-8765-e55f252f539b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27c553f-0958-4647-b411-212e65a9c569]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea44224e-38b3-45d3-ab46-b6cbaecd5b55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74c3003-6ae3-4e8e-9ffd-e26489cbdc7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:09:52 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc2682e-a553-4ab1-9813-122b499bd718]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG os_brick.utils [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updating existing volume attachment record: 4d63cfb0-a7e7-4a48-903d-bcbd22f867c4 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG nova.network.neutron [req-49915d8d-fecc-4f3a-a3c5-74ca7d8e0d06 req-eb55eeb3-b23b-45b5-b15a-2f9cac560713 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updated VIF entry in instance network info cache for port 7a6d3944-52f6-4ffc-81d1-f648b2b44f59. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG nova.network.neutron [req-49915d8d-fecc-4f3a-a3c5-74ca7d8e0d06 req-eb55eeb3-b23b-45b5-b15a-2f9cac560713 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updating instance_info_cache with network_info: [{"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:09:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-49915d8d-fecc-4f3a-a3c5-74ca7d8e0d06 req-eb55eeb3-b23b-45b5-b15a-2f9cac560713 service nova] Releasing lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:09:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:55 user nova-compute[72815]: INFO nova.compute.manager [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Unshelving
Aug 17 20:09:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:55 user nova-compute[72815]: DEBUG nova.objects.instance [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'pci_requests' on Instance uuid 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:09:55 user nova-compute[72815]: DEBUG nova.objects.instance [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'numa_topology' on Instance uuid 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:09:55 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:09:55 user nova-compute[72815]: INFO nova.compute.claims [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Claim successful on node user
Aug 17 20:09:55 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:09:55 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:09:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:56 user nova-compute[72815]: INFO nova.network.neutron [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updating port defc548f-4a74-4cdf-b1a8-12236dcf71e9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 20:09:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquired lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG nova.network.neutron [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-d9678d20-3d71-48b5-bf6e-33a651f0755f req-62fa9417-0f57-4229-bf1a-b5674cfb53dc service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-changed-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-d9678d20-3d71-48b5-bf6e-33a651f0755f req-62fa9417-0f57-4229-bf1a-b5674cfb53dc service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Refreshing instance network info cache due to event network-changed-defc548f-4a74-4cdf-b1a8-12236dcf71e9. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d9678d20-3d71-48b5-bf6e-33a651f0755f req-62fa9417-0f57-4229-bf1a-b5674cfb53dc service nova] Acquiring lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG nova.network.neutron [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updating instance_info_cache with network_info: [{"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Releasing lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:09:57 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Creating image(s)
Aug 17 20:09:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "/opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "/opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG nova.objects.instance [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d9678d20-3d71-48b5-bf6e-33a651f0755f req-62fa9417-0f57-4229-bf1a-b5674cfb53dc service nova] Acquired lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-d9678d20-3d71-48b5-bf6e-33a651f0755f req-62fa9417-0f57-4229-bf1a-b5674cfb53dc service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Refreshing network info cache for port defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "e44fa659745b75852b691d0558322864a47aa0d5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "e44fa659745b75852b691d0558322864a47aa0d5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5.part --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5.part --force-share --output=json" returned: 0 in 0.232s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG nova.virt.images [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] 2f5d1c55-471b-4029-804e-cdb6b773c42c was qcow2, converting to raw {{(pid=72815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5.part /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5.converted {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG nova.network.neutron [req-d9678d20-3d71-48b5-bf6e-33a651f0755f req-62fa9417-0f57-4229-bf1a-b5674cfb53dc service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updated VIF entry in instance network info cache for port defc548f-4a74-4cdf-b1a8-12236dcf71e9. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG nova.network.neutron [req-d9678d20-3d71-48b5-bf6e-33a651f0755f req-62fa9417-0f57-4229-bf1a-b5674cfb53dc service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updating instance_info_cache with network_info: [{"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d9678d20-3d71-48b5-bf6e-33a651f0755f req-62fa9417-0f57-4229-bf1a-b5674cfb53dc service nova] Releasing lock "refresh_cache-2ed62592-a25a-46cf-976a-5f2edbe6d5e0" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5.part /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5.converted" returned: 0 in 0.360s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5.converted --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "e44fa659745b75852b691d0558322864a47aa0d5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.786s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5 --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "e44fa659745b75852b691d0558322864a47aa0d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "e44fa659745b75852b691d0558322864a47aa0d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5 --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:09:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5,backing_fmt=raw /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5,backing_fmt=raw /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk 1073741824" returned: 0 in 0.051s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "e44fa659745b75852b691d0558322864a47aa0d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5 --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:00 user nova-compute[72815]: DEBUG nova.objects.instance [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'migration_context' on Instance uuid 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:00 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Rebasing disk image.
Aug 17 20:10:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 -F raw /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 -F raw /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk" returned: 0 in 2.304s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Ensure instance console log exists: /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Start _get_guest_xml network_info=[{"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='aba908400074aac6f99461087051c4a5',container_format='bare',created_at=2023-08-17T20:08:03Z,direct_url=<?>,disk_format='qcow2',id=2f5d1c55-471b-4029-804e-cdb6b773c42c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-592611439-shelved',owner='aa140294f17e4751b13e2d4a15b17ff9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T20:08:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:10:02 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:10:02 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='aba908400074aac6f99461087051c4a5',container_format='bare',created_at=2023-08-17T20:08:03Z,direct_url=<?>,disk_format='qcow2',id=2f5d1c55-471b-4029-804e-cdb6b773c42c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-592611439-shelved',owner='aa140294f17e4751b13e2d4a15b17ff9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T20:08:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.objects.instance [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T20:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-592611439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-592611439',id=31,image_ref='2f5d1c55-471b-4029-804e-cdb6b773c42c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1811635152',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:06:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='aa140294f17e4751b13e2d4a15b17ff9',ramdisk_id='',reservation_id='r-08iiaggg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-632866040',owner_user_name='tempest-AttachVolumeShelveTestJSON-632866040-project-member',shelved_at='2023-08-17T20:08:06.653035',shelved_host='user',shelved_image_id='2f5d1c55-471b-4029-804e-cdb6b773c42c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:09:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82d9b206cf4499eaf518f7cd6a7a10c',uuid=2ed62592-a25a-46cf-976a-5f2edbe6d5e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converting VIF {"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.objects.instance [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:10:02 user nova-compute[72815]:   <uuid>2ed62592-a25a-46cf-976a-5f2edbe6d5e0</uuid>
Aug 17 20:10:02 user nova-compute[72815]:   <name>instance-0000001f</name>
Aug 17 20:10:02 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:10:02 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:10:02 user nova-compute[72815]:   <metadata>
Aug 17 20:10:02 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:10:02 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:10:02 user nova-compute[72815]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-592611439</nova:name>
Aug 17 20:10:02 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:10:02</nova:creationTime>
Aug 17 20:10:02 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:10:02 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:10:02 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:10:02 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:10:02 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:10:02 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:10:02 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:10:02 user nova-compute[72815]:       <nova:owner>
Aug 17 20:10:02 user nova-compute[72815]:         <nova:user uuid="a82d9b206cf4499eaf518f7cd6a7a10c">tempest-AttachVolumeShelveTestJSON-632866040-project-member</nova:user>
Aug 17 20:10:02 user nova-compute[72815]:         <nova:project uuid="aa140294f17e4751b13e2d4a15b17ff9">tempest-AttachVolumeShelveTestJSON-632866040</nova:project>
Aug 17 20:10:02 user nova-compute[72815]:       </nova:owner>
Aug 17 20:10:02 user nova-compute[72815]:       <nova:root type="image" uuid="2f5d1c55-471b-4029-804e-cdb6b773c42c"/>
Aug 17 20:10:02 user nova-compute[72815]:       <nova:ports>
Aug 17 20:10:02 user nova-compute[72815]:         <nova:port uuid="defc548f-4a74-4cdf-b1a8-12236dcf71e9">
Aug 17 20:10:02 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 20:10:02 user nova-compute[72815]:         </nova:port>
Aug 17 20:10:02 user nova-compute[72815]:       </nova:ports>
Aug 17 20:10:02 user nova-compute[72815]:     </nova:instance>
Aug 17 20:10:02 user nova-compute[72815]:   </metadata>
Aug 17 20:10:02 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:10:02 user nova-compute[72815]:     <system>
Aug 17 20:10:02 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:10:02 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:10:02 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:10:02 user nova-compute[72815]:       <entry name="serial">2ed62592-a25a-46cf-976a-5f2edbe6d5e0</entry>
Aug 17 20:10:02 user nova-compute[72815]:       <entry name="uuid">2ed62592-a25a-46cf-976a-5f2edbe6d5e0</entry>
Aug 17 20:10:02 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:10:02 user nova-compute[72815]:     </system>
Aug 17 20:10:02 user nova-compute[72815]:   </sysinfo>
Aug 17 20:10:02 user nova-compute[72815]:   <os>
Aug 17 20:10:02 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:10:02 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:10:02 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:10:02 user nova-compute[72815]:   </os>
Aug 17 20:10:02 user nova-compute[72815]:   <features>
Aug 17 20:10:02 user nova-compute[72815]:     <acpi/>
Aug 17 20:10:02 user nova-compute[72815]:     <apic/>
Aug 17 20:10:02 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:10:02 user nova-compute[72815]:   </features>
Aug 17 20:10:02 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:10:02 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:10:02 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:10:02 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:10:02 user nova-compute[72815]:   </clock>
Aug 17 20:10:02 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:10:02 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:10:02 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:10:02 user nova-compute[72815]:   </cpu>
Aug 17 20:10:02 user nova-compute[72815]:   <devices>
Aug 17 20:10:02 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:10:02 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:10:02 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk"/>
Aug 17 20:10:02 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:10:02 user nova-compute[72815]:     </disk>
Aug 17 20:10:02 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:10:02 user nova-compute[72815]:       <mac address="fa:16:3e:76:67:47"/>
Aug 17 20:10:02 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:10:02 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:10:02 user nova-compute[72815]:       <target dev="tapdefc548f-4a"/>
Aug 17 20:10:02 user nova-compute[72815]:     </interface>
Aug 17 20:10:02 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:10:02 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/console.log" append="off"/>
Aug 17 20:10:02 user nova-compute[72815]:     </serial>
Aug 17 20:10:02 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:10:02 user nova-compute[72815]:     <video>
Aug 17 20:10:02 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:10:02 user nova-compute[72815]:     </video>
Aug 17 20:10:02 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:10:02 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:10:02 user nova-compute[72815]:     </rng>
Aug 17 20:10:02 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:10:02 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:10:02 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:10:02 user nova-compute[72815]:     </memballoon>
Aug 17 20:10:02 user nova-compute[72815]:   </devices>
Aug 17 20:10:02 user nova-compute[72815]: </domain>
Aug 17 20:10:02 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T20:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-592611439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-592611439',id=31,image_ref='2f5d1c55-471b-4029-804e-cdb6b773c42c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1811635152',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:06:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='aa140294f17e4751b13e2d4a15b17ff9',ramdisk_id='',reservation_id='r-08iiaggg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-632866040',owner_user_name='tempest-AttachVolumeShelveTestJSON-632866040-project-member',shelved_at='2023-08-17T20:08:06.653035',shelved_host='user',shelved_image_id='2f5d1c55-471b-4029-804e-cdb6b773c42c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:09:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82d9b206cf4499eaf518f7cd6a7a10c',uuid=2ed62592-a25a-46cf-976a-5f2edbe6d5e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converting VIF {"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG os_vif [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdefc548f-4a, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdefc548f-4a, col_values=(('external_ids', {'iface-id': 'defc548f-4a74-4cdf-b1a8-12236dcf71e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:67:47', 'vm-uuid': '2ed62592-a25a-46cf-976a-5f2edbe6d5e0'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:10:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:02 user nova-compute[72815]: INFO os_vif [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a')
Aug 17 20:10:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:10:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] No VIF found with MAC fa:16:3e:76:67:47, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPrDyYGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:10:04 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:10:04 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:10:04 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f628e7-326f-4c34-831a-5bd0d75f263c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:10:04 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbb7551-5c48-48dc-997f-344286c64be8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f] added
Aug 17 20:10:04 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cb7ebb-8b7e-49aa-b802-53fcdfb0dcb6]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9add5f2-dfa1-448d-823a-98d9cea663f7]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bPrDyYGt {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bPrDyYGt" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba797fb-b1de-4155-8103-ea1fe99edde1]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bPrDyYGt'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cb0ce9-0801-49c0-ab72-ffd39d335125]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed816d9-c35d-46ad-a2ba-0b4504df26e5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d879737e-ea4f-4dbc-81ee-d54d2ffaef9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f, portal: 172.16.0.220,3260]
Aug 17 20:10:04 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f, portal: 172.16.0.220,3260] successful.
Aug 17 20:10:04 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ff199c-1aec-416b-a2e3-b792463cbe2f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf0e6d4-4715-45e6-a778-f312460930f7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:10:04 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 (non-flash)
Aug 17 20:10:04 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:10:04 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba18c41b-c471-48ce-be30-7e8f4b9216de]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPrDyYGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-074c8459-2a81-48f4-9fee-c6481d15e062 req-0f088948-db74-451b-8abe-a41f9ac8d83b service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-074c8459-2a81-48f4-9fee-c6481d15e062 req-0f088948-db74-451b-8abe-a41f9ac8d83b service nova] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-074c8459-2a81-48f4-9fee-c6481d15e062 req-0f088948-db74-451b-8abe-a41f9ac8d83b service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-074c8459-2a81-48f4-9fee-c6481d15e062 req-0f088948-db74-451b-8abe-a41f9ac8d83b service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-074c8459-2a81-48f4-9fee-c6481d15e062 req-0f088948-db74-451b-8abe-a41f9ac8d83b service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] No waiting events found dispatching network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:10:04 user nova-compute[72815]: WARNING nova.compute.manager [req-074c8459-2a81-48f4-9fee-c6481d15e062 req-0f088948-db74-451b-8abe-a41f9ac8d83b service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received unexpected event network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 20:10:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:10:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23762616630313838', 'path': '/dev/sdg'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:10:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762616630313838', 'path': '/dev/sdg'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:10:05 user nova-compute[72815]: DEBUG nova.objects.instance [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'flavor' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:10:05 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:10:05 user nova-compute[72815]:   <source dev="/dev/sdg"/>
Aug 17 20:10:05 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:10:05 user nova-compute[72815]:   <serial>90e87f12-c09a-49cc-9b20-74249135b21f</serial>
Aug 17 20:10:05 user nova-compute[72815]: </disk>
Aug 17 20:10:05 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No VIF found with MAC fa:16:3e:c4:fd:56, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:10:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9d93b9b9-b6cf-43ca-a04b-ad0cb01f327b tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "e7e09061-f65f-444b-98f6-409da28295e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.110s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303006.7626104, 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:10:06 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] VM Resumed (Lifecycle Event)
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:10:06 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Instance spawned successfully.
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:10:06 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303006.7674792, 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:10:06 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] VM Started (Lifecycle Event)
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:10:06 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-484d069b-20b5-46b3-9552-701f89f29641 req-7a510dd9-4bfb-4bea-8431-433d9d6a9be9 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-484d069b-20b5-46b3-9552-701f89f29641 req-7a510dd9-4bfb-4bea-8431-433d9d6a9be9 service nova] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-484d069b-20b5-46b3-9552-701f89f29641 req-7a510dd9-4bfb-4bea-8431-433d9d6a9be9 service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-484d069b-20b5-46b3-9552-701f89f29641 req-7a510dd9-4bfb-4bea-8431-433d9d6a9be9 service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-484d069b-20b5-46b3-9552-701f89f29641 req-7a510dd9-4bfb-4bea-8431-433d9d6a9be9 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] No waiting events found dispatching network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:10:06 user nova-compute[72815]: WARNING nova.compute.manager [req-484d069b-20b5-46b3-9552-701f89f29641 req-7a510dd9-4bfb-4bea-8431-433d9d6a9be9 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received unexpected event network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 20:10:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:10:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-329b531e-ab54-4621-86d4-05a56eec3678 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.816s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:07 user nova-compute[72815]: INFO nova.compute.manager [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Rescuing
Aug 17 20:10:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:10:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquired lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:10:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:10:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updating instance_info_cache with network_info: [{"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Releasing lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-f0552e69-1c4c-4dab-960f-12ed123071ca req-51faaedf-bd73-4a67-97cc-da4de1e8a369 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-unplugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f0552e69-1c4c-4dab-960f-12ed123071ca req-51faaedf-bd73-4a67-97cc-da4de1e8a369 service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f0552e69-1c4c-4dab-960f-12ed123071ca req-51faaedf-bd73-4a67-97cc-da4de1e8a369 service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f0552e69-1c4c-4dab-960f-12ed123071ca req-51faaedf-bd73-4a67-97cc-da4de1e8a369 service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-f0552e69-1c4c-4dab-960f-12ed123071ca req-51faaedf-bd73-4a67-97cc-da4de1e8a369 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-unplugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:10:08 user nova-compute[72815]: WARNING nova.compute.manager [req-f0552e69-1c4c-4dab-960f-12ed123071ca req-51faaedf-bd73-4a67-97cc-da4de1e8a369 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-unplugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state active and task_state rescuing.
Aug 17 20:10:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-f0552e69-1c4c-4dab-960f-12ed123071ca req-51faaedf-bd73-4a67-97cc-da4de1e8a369 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f0552e69-1c4c-4dab-960f-12ed123071ca req-51faaedf-bd73-4a67-97cc-da4de1e8a369 service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f0552e69-1c4c-4dab-960f-12ed123071ca req-51faaedf-bd73-4a67-97cc-da4de1e8a369 service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f0552e69-1c4c-4dab-960f-12ed123071ca req-51faaedf-bd73-4a67-97cc-da4de1e8a369 service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-f0552e69-1c4c-4dab-960f-12ed123071ca req-51faaedf-bd73-4a67-97cc-da4de1e8a369 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:10:08 user nova-compute[72815]: WARNING nova.compute.manager [req-f0552e69-1c4c-4dab-960f-12ed123071ca req-51faaedf-bd73-4a67-97cc-da4de1e8a369 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state active and task_state rescuing.
Aug 17 20:10:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:09 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Instance destroyed successfully.
Aug 17 20:10:09 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Attempting rescue
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72815) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Instance directory exists: not creating {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 20:10:09 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Creating image(s)
Aug 17 20:10:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "/opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "/opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'trusted_certs' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.202s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.rescue {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.rescue" returned: 0 in 0.139s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'migration_context' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Start _get_guest_xml network_info=[{"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "vif_mac": "fa:16:3e:c4:fd:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'resources' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'numa_topology' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:09 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:10:09 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'vcpu_model' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2100679262',display_name='tempest-ServerRescueNegativeTestJSON-server-2100679262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2100679262',id=35,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQVuZd8HY1YPAnMPmmsKQMN4BVcIIqgoZWCg993IqB30y+h05kxKBZmQl9HxcfNKYfglRHgFsde7WW/VjaU0fJe/3jwAEIqfff8lEApN4BAQw9wX0KAw+Voy57bKwOKLg==',key_name='tempest-keypair-1902815982',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:08:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6d2cf2910f4d3d9924480d68057b5a',ramdisk_id='',reservation_id='r-g1lbtbjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-335799606',owner_user_name='tempest-ServerRescueNegativeTestJSON-335799606-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:08:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa27c69e40f243d9b38c87250b5dba5f',uuid=e7e09061-f65f-444b-98f6-409da28295e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "vif_mac": "fa:16:3e:c4:fd:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converting VIF {"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "vif_mac": "fa:16:3e:c4:fd:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:fd:56,bridge_name='br-int',has_traffic_filtering=True,id=7a6d3944-52f6-4ffc-81d1-f648b2b44f59,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d3944-52') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'pci_devices' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:10:09 user nova-compute[72815]:   <uuid>e7e09061-f65f-444b-98f6-409da28295e2</uuid>
Aug 17 20:10:09 user nova-compute[72815]:   <name>instance-00000023</name>
Aug 17 20:10:09 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:10:09 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:10:09 user nova-compute[72815]:   <metadata>
Aug 17 20:10:09 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:10:09 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:10:09 user nova-compute[72815]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2100679262</nova:name>
Aug 17 20:10:09 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:10:09</nova:creationTime>
Aug 17 20:10:09 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:10:09 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:10:09 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:10:09 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:10:09 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:10:09 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:10:09 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:10:09 user nova-compute[72815]:       <nova:owner>
Aug 17 20:10:09 user nova-compute[72815]:         <nova:user uuid="fa27c69e40f243d9b38c87250b5dba5f">tempest-ServerRescueNegativeTestJSON-335799606-project-member</nova:user>
Aug 17 20:10:09 user nova-compute[72815]:         <nova:project uuid="4e6d2cf2910f4d3d9924480d68057b5a">tempest-ServerRescueNegativeTestJSON-335799606</nova:project>
Aug 17 20:10:09 user nova-compute[72815]:       </nova:owner>
Aug 17 20:10:09 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:10:09 user nova-compute[72815]:       <nova:ports>
Aug 17 20:10:09 user nova-compute[72815]:         <nova:port uuid="7a6d3944-52f6-4ffc-81d1-f648b2b44f59">
Aug 17 20:10:09 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 20:10:09 user nova-compute[72815]:         </nova:port>
Aug 17 20:10:09 user nova-compute[72815]:       </nova:ports>
Aug 17 20:10:09 user nova-compute[72815]:     </nova:instance>
Aug 17 20:10:09 user nova-compute[72815]:   </metadata>
Aug 17 20:10:09 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:10:09 user nova-compute[72815]:     <system>
Aug 17 20:10:09 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:10:09 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:10:09 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:10:09 user nova-compute[72815]:       <entry name="serial">e7e09061-f65f-444b-98f6-409da28295e2</entry>
Aug 17 20:10:09 user nova-compute[72815]:       <entry name="uuid">e7e09061-f65f-444b-98f6-409da28295e2</entry>
Aug 17 20:10:09 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:10:09 user nova-compute[72815]:     </system>
Aug 17 20:10:09 user nova-compute[72815]:   </sysinfo>
Aug 17 20:10:09 user nova-compute[72815]:   <os>
Aug 17 20:10:09 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:10:09 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:10:09 user nova-compute[72815]:   </os>
Aug 17 20:10:09 user nova-compute[72815]:   <features>
Aug 17 20:10:09 user nova-compute[72815]:     <acpi/>
Aug 17 20:10:09 user nova-compute[72815]:     <apic/>
Aug 17 20:10:09 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:10:09 user nova-compute[72815]:   </features>
Aug 17 20:10:09 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:10:09 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:10:09 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:10:09 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:10:09 user nova-compute[72815]:   </clock>
Aug 17 20:10:09 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:10:09 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:10:09 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:10:09 user nova-compute[72815]:   </cpu>
Aug 17 20:10:09 user nova-compute[72815]:   <devices>
Aug 17 20:10:09 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:10:09 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:10:09 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.rescue"/>
Aug 17 20:10:09 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:10:09 user nova-compute[72815]:     </disk>
Aug 17 20:10:09 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:10:09 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:10:09 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk"/>
Aug 17 20:10:09 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 20:10:09 user nova-compute[72815]:     </disk>
Aug 17 20:10:09 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:10:09 user nova-compute[72815]:       <mac address="fa:16:3e:c4:fd:56"/>
Aug 17 20:10:09 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:10:09 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:10:09 user nova-compute[72815]:       <target dev="tap7a6d3944-52"/>
Aug 17 20:10:09 user nova-compute[72815]:     </interface>
Aug 17 20:10:09 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:10:09 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/console.log" append="off"/>
Aug 17 20:10:09 user nova-compute[72815]:     </serial>
Aug 17 20:10:09 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:10:09 user nova-compute[72815]:     <video>
Aug 17 20:10:09 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:10:09 user nova-compute[72815]:     </video>
Aug 17 20:10:09 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:10:09 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:10:09 user nova-compute[72815]:     </rng>
Aug 17 20:10:09 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:10:09 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:10:09 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:10:09 user nova-compute[72815]:     </memballoon>
Aug 17 20:10:09 user nova-compute[72815]:   </devices>
Aug 17 20:10:09 user nova-compute[72815]: </domain>
Aug 17 20:10:09 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:10:09 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Instance destroyed successfully.
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:10:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] No VIF found with MAC fa:16:3e:c4:fd:56, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:10:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a85d716-d7d5-4545-b5b9-16bb985be4f7 req-0590a0c5-90dc-49a3-8849-2869aeea0b45 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a85d716-d7d5-4545-b5b9-16bb985be4f7 req-0590a0c5-90dc-49a3-8849-2869aeea0b45 service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a85d716-d7d5-4545-b5b9-16bb985be4f7 req-0590a0c5-90dc-49a3-8849-2869aeea0b45 service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a85d716-d7d5-4545-b5b9-16bb985be4f7 req-0590a0c5-90dc-49a3-8849-2869aeea0b45 service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a85d716-d7d5-4545-b5b9-16bb985be4f7 req-0590a0c5-90dc-49a3-8849-2869aeea0b45 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:10:11 user nova-compute[72815]: WARNING nova.compute.manager [req-3a85d716-d7d5-4545-b5b9-16bb985be4f7 req-0590a0c5-90dc-49a3-8849-2869aeea0b45 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state active and task_state rescuing.
Aug 17 20:10:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for e7e09061-f65f-444b-98f6-409da28295e2 due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 20:10:13 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303013.6317742, e7e09061-f65f-444b-98f6-409da28295e2 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:10:13 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] VM Resumed (Lifecycle Event)
Aug 17 20:10:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bf18db31-4e1d-44be-a043-da9a9a26505c tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:10:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:10:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:10:13 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 20:10:13 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303013.6340573, e7e09061-f65f-444b-98f6-409da28295e2 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:10:13 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] VM Started (Lifecycle Event)
Aug 17 20:10:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-d6286504-cfa2-4f78-8514-c514f026008c req-d68b3d0d-838a-4872-8daa-55cc85604c84 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d6286504-cfa2-4f78-8514-c514f026008c req-d68b3d0d-838a-4872-8daa-55cc85604c84 service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d6286504-cfa2-4f78-8514-c514f026008c req-d68b3d0d-838a-4872-8daa-55cc85604c84 service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d6286504-cfa2-4f78-8514-c514f026008c req-d68b3d0d-838a-4872-8daa-55cc85604c84 service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-d6286504-cfa2-4f78-8514-c514f026008c req-d68b3d0d-838a-4872-8daa-55cc85604c84 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:10:13 user nova-compute[72815]: WARNING nova.compute.manager [req-d6286504-cfa2-4f78-8514-c514f026008c req-d68b3d0d-838a-4872-8daa-55cc85604c84 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state active and task_state rescuing.
Aug 17 20:10:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:10:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:10:13 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 20:10:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:14 user nova-compute[72815]: DEBUG nova.compute.manager [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:10:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:14 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:10:14 user nova-compute[72815]: INFO nova.compute.claims [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Claim successful on node user
Aug 17 20:10:15 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG nova.network.neutron [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:10:15 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:10:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG nova.policy [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a75e05392d54cfb9fcda786e3ee2efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9b4cae7404f3184fc480ffddfbbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:10:15 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Creating image(s)
Aug 17 20:10:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "/opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "/opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk 1073741824" returned: 0 in 0.053s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG nova.network.neutron [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Successfully created port: 9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Cannot resize image /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG nova.objects.instance [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'migration_context' on Instance uuid b4462060-b172-4a3b-b9ed-d6b8514c8d97 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Ensure instance console log exists: /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.network.neutron [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Successfully updated port: 9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "refresh_cache-b4462060-b172-4a3b-b9ed-d6b8514c8d97" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquired lock "refresh_cache-b4462060-b172-4a3b-b9ed-d6b8514c8d97" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.network.neutron [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-6cf7779e-875d-4d11-82d4-c3640f85acce req-a330ae60-d0a6-4dd7-9e61-a51aa98f7272 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Received event network-changed-9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-6cf7779e-875d-4d11-82d4-c3640f85acce req-a330ae60-d0a6-4dd7-9e61-a51aa98f7272 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Refreshing instance network info cache due to event network-changed-9955b382-2169-4d4e-a593-a85808d52584. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6cf7779e-875d-4d11-82d4-c3640f85acce req-a330ae60-d0a6-4dd7-9e61-a51aa98f7272 service nova] Acquiring lock "refresh_cache-b4462060-b172-4a3b-b9ed-d6b8514c8d97" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.network.neutron [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.network.neutron [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Updating instance_info_cache with network_info: [{"id": "9955b382-2169-4d4e-a593-a85808d52584", "address": "fa:16:3e:4d:1b:d5", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9955b382-21", "ovs_interfaceid": "9955b382-2169-4d4e-a593-a85808d52584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Releasing lock "refresh_cache-b4462060-b172-4a3b-b9ed-d6b8514c8d97" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Instance network_info: |[{"id": "9955b382-2169-4d4e-a593-a85808d52584", "address": "fa:16:3e:4d:1b:d5", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9955b382-21", "ovs_interfaceid": "9955b382-2169-4d4e-a593-a85808d52584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6cf7779e-875d-4d11-82d4-c3640f85acce req-a330ae60-d0a6-4dd7-9e61-a51aa98f7272 service nova] Acquired lock "refresh_cache-b4462060-b172-4a3b-b9ed-d6b8514c8d97" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.network.neutron [req-6cf7779e-875d-4d11-82d4-c3640f85acce req-a330ae60-d0a6-4dd7-9e61-a51aa98f7272 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Refreshing network info cache for port 9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Start _get_guest_xml network_info=[{"id": "9955b382-2169-4d4e-a593-a85808d52584", "address": "fa:16:3e:4d:1b:d5", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9955b382-21", "ovs_interfaceid": "9955b382-2169-4d4e-a593-a85808d52584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:10:17 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:10:17 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:10:17 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1870413469',display_name='tempest-AttachVolumeNegativeTest-server-1870413469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1870413469',id=38,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3QHZ4n34gdnKdzp6fxfrSwipSKR5dj0h0ieeyWuY8vqqzZgHUkSKr3VlsgwGCRRnvL82l4H6GStBRJ/u/eHI/ObcPTPsxYaw+KmE/eHbANBddcersfMZqtozitEhSRgQ==',key_name='tempest-keypair-1245324752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ee9b4cae7404f3184fc480ffddfbbcd',ramdisk_id='',reservation_id='r-bmbkfxuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1950293532',owner_user_name='tempest-AttachVolumeNegativeTest-1950293532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:10:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a75e05392d54cfb9fcda786e3ee2efc',uuid=b4462060-b172-4a3b-b9ed-d6b8514c8d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9955b382-2169-4d4e-a593-a85808d52584", "address": "fa:16:3e:4d:1b:d5", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9955b382-21", "ovs_interfaceid": "9955b382-2169-4d4e-a593-a85808d52584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converting VIF {"id": "9955b382-2169-4d4e-a593-a85808d52584", "address": "fa:16:3e:4d:1b:d5", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9955b382-21", "ovs_interfaceid": "9955b382-2169-4d4e-a593-a85808d52584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=9955b382-2169-4d4e-a593-a85808d52584,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9955b382-21') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG nova.objects.instance [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'pci_devices' on Instance uuid b4462060-b172-4a3b-b9ed-d6b8514c8d97 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:10:18 user nova-compute[72815]:   <uuid>b4462060-b172-4a3b-b9ed-d6b8514c8d97</uuid>
Aug 17 20:10:18 user nova-compute[72815]:   <name>instance-00000026</name>
Aug 17 20:10:18 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:10:18 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:10:18 user nova-compute[72815]:   <metadata>
Aug 17 20:10:18 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:10:18 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:10:18 user nova-compute[72815]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1870413469</nova:name>
Aug 17 20:10:18 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:10:17</nova:creationTime>
Aug 17 20:10:18 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:10:18 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:10:18 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:10:18 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:10:18 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:10:18 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:10:18 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:10:18 user nova-compute[72815]:       <nova:owner>
Aug 17 20:10:18 user nova-compute[72815]:         <nova:user uuid="2a75e05392d54cfb9fcda786e3ee2efc">tempest-AttachVolumeNegativeTest-1950293532-project-member</nova:user>
Aug 17 20:10:18 user nova-compute[72815]:         <nova:project uuid="9ee9b4cae7404f3184fc480ffddfbbcd">tempest-AttachVolumeNegativeTest-1950293532</nova:project>
Aug 17 20:10:18 user nova-compute[72815]:       </nova:owner>
Aug 17 20:10:18 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:10:18 user nova-compute[72815]:       <nova:ports>
Aug 17 20:10:18 user nova-compute[72815]:         <nova:port uuid="9955b382-2169-4d4e-a593-a85808d52584">
Aug 17 20:10:18 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 20:10:18 user nova-compute[72815]:         </nova:port>
Aug 17 20:10:18 user nova-compute[72815]:       </nova:ports>
Aug 17 20:10:18 user nova-compute[72815]:     </nova:instance>
Aug 17 20:10:18 user nova-compute[72815]:   </metadata>
Aug 17 20:10:18 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:10:18 user nova-compute[72815]:     <system>
Aug 17 20:10:18 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:10:18 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:10:18 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:10:18 user nova-compute[72815]:       <entry name="serial">b4462060-b172-4a3b-b9ed-d6b8514c8d97</entry>
Aug 17 20:10:18 user nova-compute[72815]:       <entry name="uuid">b4462060-b172-4a3b-b9ed-d6b8514c8d97</entry>
Aug 17 20:10:18 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:10:18 user nova-compute[72815]:     </system>
Aug 17 20:10:18 user nova-compute[72815]:   </sysinfo>
Aug 17 20:10:18 user nova-compute[72815]:   <os>
Aug 17 20:10:18 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:10:18 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:10:18 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:10:18 user nova-compute[72815]:   </os>
Aug 17 20:10:18 user nova-compute[72815]:   <features>
Aug 17 20:10:18 user nova-compute[72815]:     <acpi/>
Aug 17 20:10:18 user nova-compute[72815]:     <apic/>
Aug 17 20:10:18 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:10:18 user nova-compute[72815]:   </features>
Aug 17 20:10:18 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:10:18 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:10:18 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:10:18 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:10:18 user nova-compute[72815]:   </clock>
Aug 17 20:10:18 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:10:18 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:10:18 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:10:18 user nova-compute[72815]:   </cpu>
Aug 17 20:10:18 user nova-compute[72815]:   <devices>
Aug 17 20:10:18 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:10:18 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:10:18 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk"/>
Aug 17 20:10:18 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:10:18 user nova-compute[72815]:     </disk>
Aug 17 20:10:18 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:10:18 user nova-compute[72815]:       <mac address="fa:16:3e:4d:1b:d5"/>
Aug 17 20:10:18 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:10:18 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:10:18 user nova-compute[72815]:       <target dev="tap9955b382-21"/>
Aug 17 20:10:18 user nova-compute[72815]:     </interface>
Aug 17 20:10:18 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:10:18 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/console.log" append="off"/>
Aug 17 20:10:18 user nova-compute[72815]:     </serial>
Aug 17 20:10:18 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:10:18 user nova-compute[72815]:     <video>
Aug 17 20:10:18 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:10:18 user nova-compute[72815]:     </video>
Aug 17 20:10:18 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:10:18 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:10:18 user nova-compute[72815]:     </rng>
Aug 17 20:10:18 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:10:18 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:10:18 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:10:18 user nova-compute[72815]:     </memballoon>
Aug 17 20:10:18 user nova-compute[72815]:   </devices>
Aug 17 20:10:18 user nova-compute[72815]: </domain>
Aug 17 20:10:18 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1870413469',display_name='tempest-AttachVolumeNegativeTest-server-1870413469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1870413469',id=38,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3QHZ4n34gdnKdzp6fxfrSwipSKR5dj0h0ieeyWuY8vqqzZgHUkSKr3VlsgwGCRRnvL82l4H6GStBRJ/u/eHI/ObcPTPsxYaw+KmE/eHbANBddcersfMZqtozitEhSRgQ==',key_name='tempest-keypair-1245324752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ee9b4cae7404f3184fc480ffddfbbcd',ramdisk_id='',reservation_id='r-bmbkfxuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1950293532',owner_user_name='tempest-AttachVolumeNegativeTest-1950293532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:10:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a75e05392d54cfb9fcda786e3ee2efc',uuid=b4462060-b172-4a3b-b9ed-d6b8514c8d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9955b382-2169-4d4e-a593-a85808d52584", "address": "fa:16:3e:4d:1b:d5", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9955b382-21", "ovs_interfaceid": "9955b382-2169-4d4e-a593-a85808d52584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converting VIF {"id": "9955b382-2169-4d4e-a593-a85808d52584", "address": "fa:16:3e:4d:1b:d5", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9955b382-21", "ovs_interfaceid": "9955b382-2169-4d4e-a593-a85808d52584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=9955b382-2169-4d4e-a593-a85808d52584,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9955b382-21') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG os_vif [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=9955b382-2169-4d4e-a593-a85808d52584,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9955b382-21') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9955b382-21, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9955b382-21, col_values=(('external_ids', {'iface-id': '9955b382-2169-4d4e-a593-a85808d52584', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:1b:d5', 'vm-uuid': 'b4462060-b172-4a3b-b9ed-d6b8514c8d97'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:18 user nova-compute[72815]: INFO os_vif [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=9955b382-2169-4d4e-a593-a85808d52584,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9955b382-21')
Aug 17 20:10:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No VIF found with MAC fa:16:3e:4d:1b:d5, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG nova.network.neutron [req-6cf7779e-875d-4d11-82d4-c3640f85acce req-a330ae60-d0a6-4dd7-9e61-a51aa98f7272 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Updated VIF entry in instance network info cache for port 9955b382-2169-4d4e-a593-a85808d52584. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG nova.network.neutron [req-6cf7779e-875d-4d11-82d4-c3640f85acce req-a330ae60-d0a6-4dd7-9e61-a51aa98f7272 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Updating instance_info_cache with network_info: [{"id": "9955b382-2169-4d4e-a593-a85808d52584", "address": "fa:16:3e:4d:1b:d5", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9955b382-21", "ovs_interfaceid": "9955b382-2169-4d4e-a593-a85808d52584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:10:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6cf7779e-875d-4d11-82d4-c3640f85acce req-a330ae60-d0a6-4dd7-9e61-a51aa98f7272 service nova] Releasing lock "refresh_cache-b4462060-b172-4a3b-b9ed-d6b8514c8d97" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-6210ae37-fccb-409b-a1af-652e5c82aec9 req-ac6e5c9d-25a8-40c0-9010-845c22639047 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Received event network-vif-plugged-9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6210ae37-fccb-409b-a1af-652e5c82aec9 req-ac6e5c9d-25a8-40c0-9010-845c22639047 service nova] Acquiring lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6210ae37-fccb-409b-a1af-652e5c82aec9 req-ac6e5c9d-25a8-40c0-9010-845c22639047 service nova] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6210ae37-fccb-409b-a1af-652e5c82aec9 req-ac6e5c9d-25a8-40c0-9010-845c22639047 service nova] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-6210ae37-fccb-409b-a1af-652e5c82aec9 req-ac6e5c9d-25a8-40c0-9010-845c22639047 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] No waiting events found dispatching network-vif-plugged-9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:10:20 user nova-compute[72815]: WARNING nova.compute.manager [req-6210ae37-fccb-409b-a1af-652e5c82aec9 req-ac6e5c9d-25a8-40c0-9010-845c22639047 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Received unexpected event network-vif-plugged-9955b382-2169-4d4e-a593-a85808d52584 for instance with vm_state building and task_state spawning.
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 1a714bfa-0b06-4ef8-865a-819abbc64be5 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid ab784398-43df-4214-bdd3-22c652ac710f {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid ac6faff5-9700-4504-81d8-8ba2ab64d85f {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid ec0afde2-8d2b-451a-a226-be933e28ad6f {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 12a34846-1670-4c6c-ac7d-522530aaf3a7 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid caffa446-5b29-4c5d-b756-4cc7119676cf {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 4c630764-4e1b-4bab-b354-1389cd60f5a5 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 8ac64ac9-a49d-4c70-956b-3a140da5ede8 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 690ec89d-7800-4062-a912-7b7d38474b59 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 62614d4a-13bb-4c75-8f84-c47bdbf7b024 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid b4462060-b172-4a3b-b9ed-d6b8514c8d97 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "1a714bfa-0b06-4ef8-865a-819abbc64be5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "ab784398-43df-4214-bdd3-22c652ac710f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ab784398-43df-4214-bdd3-22c652ac710f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "12a34846-1670-4c6c-ac7d-522530aaf3a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "e7e09061-f65f-444b-98f6-409da28295e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "690ec89d-7800-4062-a912-7b7d38474b59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "690ec89d-7800-4062-a912-7b7d38474b59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ab784398-43df-4214-bdd3-22c652ac710f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.184s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.205s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.218s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.221s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "690ec89d-7800-4062-a912-7b7d38474b59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.228s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.242s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "e7e09061-f65f-444b-98f6-409da28295e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.255s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.271s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-5e99768d-4e55-47ec-b332-850fe8670f7a req-bfe932b0-d12c-4f32-8c9e-693ebf31f990 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Received event network-vif-plugged-9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5e99768d-4e55-47ec-b332-850fe8670f7a req-bfe932b0-d12c-4f32-8c9e-693ebf31f990 service nova] Acquiring lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5e99768d-4e55-47ec-b332-850fe8670f7a req-bfe932b0-d12c-4f32-8c9e-693ebf31f990 service nova] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5e99768d-4e55-47ec-b332-850fe8670f7a req-bfe932b0-d12c-4f32-8c9e-693ebf31f990 service nova] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-5e99768d-4e55-47ec-b332-850fe8670f7a req-bfe932b0-d12c-4f32-8c9e-693ebf31f990 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] No waiting events found dispatching network-vif-plugged-9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:10:22 user nova-compute[72815]: WARNING nova.compute.manager [req-5e99768d-4e55-47ec-b332-850fe8670f7a req-bfe932b0-d12c-4f32-8c9e-693ebf31f990 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Received unexpected event network-vif-plugged-9955b382-2169-4d4e-a593-a85808d52584 for instance with vm_state building and task_state spawning.
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303023.0021498, b4462060-b172-4a3b-b9ed-d6b8514c8d97 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:10:23 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] VM Resumed (Lifecycle Event)
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:10:23 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Instance spawned successfully.
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:10:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:23 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303023.0187762, b4462060-b172-4a3b-b9ed-d6b8514c8d97 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:10:23 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] VM Started (Lifecycle Event)
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:10:23 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:10:23 user nova-compute[72815]: INFO nova.compute.manager [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Took 7.37 seconds to spawn the instance on the hypervisor.
Aug 17 20:10:23 user nova-compute[72815]: DEBUG nova.compute.manager [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:10:23 user nova-compute[72815]: INFO nova.compute.manager [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Took 8.48 seconds to build instance.
Aug 17 20:10:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-867968e4-03e7-4ca1-b2f5-6694b03e90c0 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.584s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.600s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:23 user nova-compute[72815]: INFO nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:10:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:24 user nova-compute[72815]: INFO nova.compute.manager [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Detaching volume 30a7c14a-c4bd-4bdd-9f88-3d259f92b215
Aug 17 20:10:24 user nova-compute[72815]: INFO nova.virt.block_device [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Attempting to driver detach volume 30a7c14a-c4bd-4bdd-9f88-3d259f92b215 from mountpoint /dev/vdb
Aug 17 20:10:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Attempting to detach device vdb from instance 99693a7e-71e3-4543-b649-41a147c77c7e from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:10:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:10:24 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:10:24 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 20:10:24 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:10:24 user nova-compute[72815]:   <serial>30a7c14a-c4bd-4bdd-9f88-3d259f92b215</serial>
Aug 17 20:10:24 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:10:24 user nova-compute[72815]: </disk>
Aug 17 20:10:24 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:10:24 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Successfully detached device vdb from instance 99693a7e-71e3-4543-b649-41a147c77c7e from the persistent domain config.
Aug 17 20:10:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99693a7e-71e3-4543-b649-41a147c77c7e from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:10:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:10:24 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:10:24 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 20:10:24 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:10:24 user nova-compute[72815]:   <serial>30a7c14a-c4bd-4bdd-9f88-3d259f92b215</serial>
Aug 17 20:10:24 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:10:24 user nova-compute[72815]: </disk>
Aug 17 20:10:24 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692303025.1750512, 99693a7e-71e3-4543-b649-41a147c77c7e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:10:25 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Successfully detached device vdb from instance 99693a7e-71e3-4543-b649-41a147c77c7e from the live domain config.
Aug 17 20:10:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LaBPgUGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:10:25 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c477ccd9-5a88-4cee-a62f-6f71c61f33db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c12232-c29c-48e1-bdba-01bfa5e18e80]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:10:25 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:10:25 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:10:25 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:10:25 user nova-compute[72815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 (non-flash)
Aug 17 20:10:25 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:10:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:10:25 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:10:25 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:10:25 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:10:25 user nova-compute[72815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 (non-flash)
Aug 17 20:10:25 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:10:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39c3fdb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215'): ({'sdf'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Removing single pathed devices sdf {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cf5f8e-78c9-4b71-9165-c1aed01c5924]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67b8fe9-309e-401d-a5a7-ed2f20e25540]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Flushing IO for device /dev/sdf {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ec6aca-a736-4299-9b5f-d7ca6235229c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[669a55b9-7866-497e-8c14-259a61918820]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4813d1-10e3-41c3-a7e4-ebd1c4593bd9]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada4755a-a82e-41ea-94d2-fdbf1630f3e4]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215, portal: 172.16.0.220,3260]
Aug 17 20:10:25 user nova-compute[72815]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215, portal: 172.16.0.220,3260] successful.
Aug 17 20:10:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a7c14a-c4bd-4bdd-9f88-3d259f92b215 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c1938e-3d95-40d2-9143-d273db6efe02]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] <== disconnect_volume: return (401ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:10:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:10:26 user nova-compute[72815]: DEBUG nova.objects.instance [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'flavor' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3f6195f0-bdce-46ac-ba50-c55905e62008 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:33 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:10:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "690ec89d-7800-4062-a912-7b7d38474b59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "690ec89d-7800-4062-a912-7b7d38474b59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "690ec89d-7800-4062-a912-7b7d38474b59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "690ec89d-7800-4062-a912-7b7d38474b59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "690ec89d-7800-4062-a912-7b7d38474b59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:34 user nova-compute[72815]: INFO nova.compute.manager [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Terminating instance
Aug 17 20:10:34 user nova-compute[72815]: DEBUG nova.compute.manager [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-77c2d74d-68c4-48b2-8781-d6d8ae704501 req-8e3e74fa-4760-4416-bbb2-b842897d14bd service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Received event network-vif-unplugged-b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-77c2d74d-68c4-48b2-8781-d6d8ae704501 req-8e3e74fa-4760-4416-bbb2-b842897d14bd service nova] Acquiring lock "690ec89d-7800-4062-a912-7b7d38474b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-77c2d74d-68c4-48b2-8781-d6d8ae704501 req-8e3e74fa-4760-4416-bbb2-b842897d14bd service nova] Lock "690ec89d-7800-4062-a912-7b7d38474b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-77c2d74d-68c4-48b2-8781-d6d8ae704501 req-8e3e74fa-4760-4416-bbb2-b842897d14bd service nova] Lock "690ec89d-7800-4062-a912-7b7d38474b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-77c2d74d-68c4-48b2-8781-d6d8ae704501 req-8e3e74fa-4760-4416-bbb2-b842897d14bd service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] No waiting events found dispatching network-vif-unplugged-b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG nova.compute.manager [req-77c2d74d-68c4-48b2-8781-d6d8ae704501 req-8e3e74fa-4760-4416-bbb2-b842897d14bd service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Received event network-vif-unplugged-b891ebda-fc59-46c7-be66-25ab4446c7c1 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:10:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:35 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Instance destroyed successfully.
Aug 17 20:10:35 user nova-compute[72815]: DEBUG nova.objects.instance [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lazy-loading 'resources' on Instance uuid 690ec89d-7800-4062-a912-7b7d38474b59 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-981235990',display_name='tempest-ServersNegativeTestJSON-server-981235990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-981235990',id=36,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d68603e63804620b9bacd300d254000',ramdisk_id='',reservation_id='r-c0fbep2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-128301023',owner_user_name='tempest-ServersNegativeTestJSON-128301023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:08:52Z,user_data=None,user_id='1c18f1cf89be4c63a7ad48ec390c6213',uuid=690ec89d-7800-4062-a912-7b7d38474b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "address": "fa:16:3e:9a:ea:b9", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb891ebda-fc", "ovs_interfaceid": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Converting VIF {"id": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "address": "fa:16:3e:9a:ea:b9", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb891ebda-fc", "ovs_interfaceid": "b891ebda-fc59-46c7-be66-25ab4446c7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=b891ebda-fc59-46c7-be66-25ab4446c7c1,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb891ebda-fc') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG os_vif [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=b891ebda-fc59-46c7-be66-25ab4446c7c1,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb891ebda-fc') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb891ebda-fc, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:35 user nova-compute[72815]: INFO os_vif [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=b891ebda-fc59-46c7-be66-25ab4446c7c1,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb891ebda-fc')
Aug 17 20:10:35 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Deleting instance files /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59_del
Aug 17 20:10:35 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Deletion of /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59_del complete
Aug 17 20:10:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk --force-share --output=json" returned: 1 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk --force-share --output=json' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:10:35 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000024, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/690ec89d-7800-4062-a912-7b7d38474b59/disk
Aug 17 20:10:35 user nova-compute[72815]: INFO nova.compute.manager [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 17 20:10:35 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG nova.compute.manager [req-01ede0a6-d34d-4486-8442-b0d0b0bf2266 req-14d8d18a-9a03-4774-89d3-6bab5dca6d21 service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Received event network-vif-deleted-b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:36 user nova-compute[72815]: INFO nova.compute.manager [req-01ede0a6-d34d-4486-8442-b0d0b0bf2266 req-14d8d18a-9a03-4774-89d3-6bab5dca6d21 service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Neutron deleted interface b891ebda-fc59-46c7-be66-25ab4446c7c1; detaching it from the instance and deleting it from the info cache
Aug 17 20:10:36 user nova-compute[72815]: DEBUG nova.network.neutron [req-01ede0a6-d34d-4486-8442-b0d0b0bf2266 req-14d8d18a-9a03-4774-89d3-6bab5dca6d21 service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:10:36 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Took 0.52 seconds to deallocate network for instance.
Aug 17 20:10:36 user nova-compute[72815]: DEBUG nova.compute.manager [req-01ede0a6-d34d-4486-8442-b0d0b0bf2266 req-14d8d18a-9a03-4774-89d3-6bab5dca6d21 service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Detach interface failed, port_id=b891ebda-fc59-46c7-be66-25ab4446c7c1, reason: Instance 690ec89d-7800-4062-a912-7b7d38474b59 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.593s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:36 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Deleted allocations for instance 690ec89d-7800-4062-a912-7b7d38474b59
Aug 17 20:10:36 user nova-compute[72815]: DEBUG nova.compute.manager [req-095962f9-0f93-4541-9ebc-23930abd9e7b req-8bacdae3-22f1-4dc5-92cf-940a2694a97e service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Received event network-vif-plugged-b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-095962f9-0f93-4541-9ebc-23930abd9e7b req-8bacdae3-22f1-4dc5-92cf-940a2694a97e service nova] Acquiring lock "690ec89d-7800-4062-a912-7b7d38474b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-095962f9-0f93-4541-9ebc-23930abd9e7b req-8bacdae3-22f1-4dc5-92cf-940a2694a97e service nova] Lock "690ec89d-7800-4062-a912-7b7d38474b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-095962f9-0f93-4541-9ebc-23930abd9e7b req-8bacdae3-22f1-4dc5-92cf-940a2694a97e service nova] Lock "690ec89d-7800-4062-a912-7b7d38474b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG nova.compute.manager [req-095962f9-0f93-4541-9ebc-23930abd9e7b req-8bacdae3-22f1-4dc5-92cf-940a2694a97e service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] No waiting events found dispatching network-vif-plugged-b891ebda-fc59-46c7-be66-25ab4446c7c1 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:10:36 user nova-compute[72815]: WARNING nova.compute.manager [req-095962f9-0f93-4541-9ebc-23930abd9e7b req-8bacdae3-22f1-4dc5-92cf-940a2694a97e service nova] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Received unexpected event network-vif-plugged-b891ebda-fc59-46c7-be66-25ab4446c7c1 for instance with vm_state deleted and task_state None.
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cbd0b80d-2b66-4cb2-a022-26d2daefa8f7 tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "690ec89d-7800-4062-a912-7b7d38474b59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.597s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:37 user nova-compute[72815]: INFO nova.compute.manager [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Terminating instance
Aug 17 20:10:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:10:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-d18440d2-cc34-4927-bd8f-d3ac4ce07336 req-94a30155-b28f-42a1-9f28-75da0fc916f8 service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-unplugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d18440d2-cc34-4927-bd8f-d3ac4ce07336 req-94a30155-b28f-42a1-9f28-75da0fc916f8 service nova] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d18440d2-cc34-4927-bd8f-d3ac4ce07336 req-94a30155-b28f-42a1-9f28-75da0fc916f8 service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d18440d2-cc34-4927-bd8f-d3ac4ce07336 req-94a30155-b28f-42a1-9f28-75da0fc916f8 service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-d18440d2-cc34-4927-bd8f-d3ac4ce07336 req-94a30155-b28f-42a1-9f28-75da0fc916f8 service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] No waiting events found dispatching network-vif-unplugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-d18440d2-cc34-4927-bd8f-d3ac4ce07336 req-94a30155-b28f-42a1-9f28-75da0fc916f8 service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-unplugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:38 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Instance destroyed successfully.
Aug 17 20:10:38 user nova-compute[72815]: DEBUG nova.objects.instance [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'resources' on Instance uuid caffa446-5b29-4c5d-b756-4cc7119676cf {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1142280768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1142280768',id=27,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:07:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-xdar94bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:08:52Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=caffa446-5b29-4c5d-b756-4cc7119676cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "address": "fa:16:3e:45:fd:f8", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd534e6-dc", "ovs_interfaceid": "cdd534e6-dcf7-4ddc-8654-5140e12727b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:fd:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdd534e6-dcf7-4ddc-8654-5140e12727b0,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd534e6-dc') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_vif [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:fd:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdd534e6-dcf7-4ddc-8654-5140e12727b0,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd534e6-dc') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdd534e6-dc, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:38 user nova-compute[72815]: INFO os_vif [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:fd:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdd534e6-dcf7-4ddc-8654-5140e12727b0,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd534e6-dc')
Aug 17 20:10:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaCkUeRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:10:38 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e79ea7-93db-4d79-86dc-672bf82d78d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b57030-7395-49fc-9776-bdad90207281]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:10:38 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:10:38 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:10:38 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:10:38 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:10:38 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:10:38 user nova-compute[72815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 (non-flash)
Aug 17 20:10:38 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:10:38 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:10:38 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:10:38 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944a6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2'): ({'sdb'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Removing single pathed devices sdb {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe5613e-2f8e-48cd-bcc7-e2f6496770c6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadf0ef5-32ce-4f6f-9e83-8de07a0c98a3]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flushing IO for device /dev/sdb {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9b51a3-910a-4a36-a1fc-94dab8cee970]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b166cff-f027-4c96-b916-c913b655c303]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:10:38 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbfc054-136d-4dbb-94ac-b28c1b9df192]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a69182-f385-47a2-bc28-2f5bc26d2a50]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2, portal: 172.16.0.220,3260]
Aug 17 20:10:39 user nova-compute[72815]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2, portal: 172.16.0.220,3260] successful.
Aug 17 20:10:39 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f313bf-5497-49a4-836b-79e22cbf75a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a85717-95d5-42bf-93a0-843e90c12cd9]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] <== disconnect_volume: return (403ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:10:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Deleting instance files /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf_del
Aug 17 20:10:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Deletion of /opt/stack/data/nova/instances/caffa446-5b29-4c5d-b756-4cc7119676cf_del complete
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:39 user nova-compute[72815]: INFO nova.compute.manager [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:10:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-f1c0868d-a11e-48ab-9994-189a01f6603d req-9cfd258e-dd33-4498-9e84-cf28a38745be service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f1c0868d-a11e-48ab-9994-189a01f6603d req-9cfd258e-dd33-4498-9e84-cf28a38745be service nova] Acquiring lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f1c0868d-a11e-48ab-9994-189a01f6603d req-9cfd258e-dd33-4498-9e84-cf28a38745be service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f1c0868d-a11e-48ab-9994-189a01f6603d req-9cfd258e-dd33-4498-9e84-cf28a38745be service nova] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-f1c0868d-a11e-48ab-9994-189a01f6603d req-9cfd258e-dd33-4498-9e84-cf28a38745be service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] No waiting events found dispatching network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:10:40 user nova-compute[72815]: WARNING nova.compute.manager [req-f1c0868d-a11e-48ab-9994-189a01f6603d req-9cfd258e-dd33-4498-9e84-cf28a38745be service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received unexpected event network-vif-plugged-cdd534e6-dcf7-4ddc-8654-5140e12727b0 for instance with vm_state active and task_state deleting.
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-566f581f-e113-4825-b45a-756d6640b439 req-40b83107-7468-4956-94cc-bfebca27dd7e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Received event network-vif-deleted-cdd534e6-dcf7-4ddc-8654-5140e12727b0 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:40 user nova-compute[72815]: INFO nova.compute.manager [req-566f581f-e113-4825-b45a-756d6640b439 req-40b83107-7468-4956-94cc-bfebca27dd7e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Neutron deleted interface cdd534e6-dcf7-4ddc-8654-5140e12727b0; detaching it from the instance and deleting it from the info cache
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.network.neutron [req-566f581f-e113-4825-b45a-756d6640b439 req-40b83107-7468-4956-94cc-bfebca27dd7e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:10:40 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:10:40 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=6684MB free_disk=25.117366790771484GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:40 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Took 1.10 seconds to deallocate network for instance.
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-566f581f-e113-4825-b45a-756d6640b439 req-40b83107-7468-4956-94cc-bfebca27dd7e service nova] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Detach interface failed, port_id=cdd534e6-dcf7-4ddc-8654-5140e12727b0, reason: Instance caffa446-5b29-4c5d-b756-4cc7119676cf could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 12a34846-1670-4c6c-ac7d-522530aaf3a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance caffa446-5b29-4c5d-b756-4cc7119676cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 8ac64ac9-a49d-4c70-956b-3a140da5ede8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 4c630764-4e1b-4bab-b354-1389cd60f5a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 99693a7e-71e3-4543-b649-41a147c77c7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance e7e09061-f65f-444b-98f6-409da28295e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 62614d4a-13bb-4c75-8f84-c47bdbf7b024 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance b4462060-b172-4a3b-b9ed-d6b8514c8d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:10:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:41 user nova-compute[72815]: INFO nova.compute.manager [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Took 0.78 seconds to detach 1 volumes for instance.
Aug 17 20:10:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:41 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:10:41 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:10:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:41 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Deleted allocations for instance caffa446-5b29-4c5d-b756-4cc7119676cf
Aug 17 20:10:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9e674db8-5762-441e-9422-ab5a03e07297 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "caffa446-5b29-4c5d-b756-4cc7119676cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.961s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:10:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:10:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Updating instance_info_cache with network_info: [{"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-ac6faff5-9700-4504-81d8-8ba2ab64d85f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:10:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:50 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303035.3258793, 690ec89d-7800-4062-a912-7b7d38474b59 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:10:50 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] VM Stopped (Lifecycle Event)
Aug 17 20:10:50 user nova-compute[72815]: DEBUG nova.compute.manager [None req-62cc7eff-303c-4a50-bea2-ca447d628c45 None None] [instance: 690ec89d-7800-4062-a912-7b7d38474b59] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:10:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-84d47223-7ab6-48e1-89e4-b0632085c7ea req-cd43fdc6-a1e7-4c2a-9270-f59843b0b243 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Received event network-changed-df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:10:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-84d47223-7ab6-48e1-89e4-b0632085c7ea req-cd43fdc6-a1e7-4c2a-9270-f59843b0b243 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Refreshing instance network info cache due to event network-changed-df957619-7f8e-4b2a-9dc8-7d7be2d09c51. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:10:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-84d47223-7ab6-48e1-89e4-b0632085c7ea req-cd43fdc6-a1e7-4c2a-9270-f59843b0b243 service nova] Acquiring lock "refresh_cache-62614d4a-13bb-4c75-8f84-c47bdbf7b024" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:10:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-84d47223-7ab6-48e1-89e4-b0632085c7ea req-cd43fdc6-a1e7-4c2a-9270-f59843b0b243 service nova] Acquired lock "refresh_cache-62614d4a-13bb-4c75-8f84-c47bdbf7b024" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:10:52 user nova-compute[72815]: DEBUG nova.network.neutron [req-84d47223-7ab6-48e1-89e4-b0632085c7ea req-cd43fdc6-a1e7-4c2a-9270-f59843b0b243 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Refreshing network info cache for port df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:10:53 user nova-compute[72815]: DEBUG nova.network.neutron [req-84d47223-7ab6-48e1-89e4-b0632085c7ea req-cd43fdc6-a1e7-4c2a-9270-f59843b0b243 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Updated VIF entry in instance network info cache for port df957619-7f8e-4b2a-9dc8-7d7be2d09c51. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:10:53 user nova-compute[72815]: DEBUG nova.network.neutron [req-84d47223-7ab6-48e1-89e4-b0632085c7ea req-cd43fdc6-a1e7-4c2a-9270-f59843b0b243 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Updating instance_info_cache with network_info: [{"id": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "address": "fa:16:3e:f6:fd:19", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf957619-7f", "ovs_interfaceid": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:10:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-84d47223-7ab6-48e1-89e4-b0632085c7ea req-cd43fdc6-a1e7-4c2a-9270-f59843b0b243 service nova] Releasing lock "refresh_cache-62614d4a-13bb-4c75-8f84-c47bdbf7b024" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:10:53 user nova-compute[72815]: INFO nova.compute.manager [None req-f69cdcbe-2738-4974-920f-55a106806a2d tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Get console output
Aug 17 20:10:53 user nova-compute[72815]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 17 20:10:53 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303038.6035998, caffa446-5b29-4c5d-b756-4cc7119676cf => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:10:53 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] VM Stopped (Lifecycle Event)
Aug 17 20:10:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-afdb9ac9-4a8b-45e4-9f32-e9df79c9dba2 None None] [instance: caffa446-5b29-4c5d-b756-4cc7119676cf] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:10:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:58 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:10:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:10:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:58 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:10:58 user nova-compute[72815]: INFO nova.compute.claims [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Claim successful on node user
Aug 17 20:10:59 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:10:59 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:10:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG nova.policy [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b344ee6f91744dd79f8a884a9212da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d837d09a38d4d97a262d1ca77c00134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:10:59 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Creating image(s)
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "/opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "/opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.175s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk 1073741824" returned: 0 in 0.048s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:10:59 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.173s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:00 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:11:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:00 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Cannot resize image /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:11:00 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lazy-loading 'migration_context' on Instance uuid 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:11:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:11:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Ensure instance console log exists: /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:11:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:00 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Successfully created port: d5b95762-5800-49c5-9cf1-f8582b17c337 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Successfully updated port: d5b95762-5800-49c5-9cf1-f8582b17c337 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "refresh_cache-4d1f0f1d-f55f-4aa3-b642-512ff95b5955" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquired lock "refresh_cache-4d1f0f1d-f55f-4aa3-b642-512ff95b5955" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-2166b5d0-a361-4e82-a98d-53ab914a583e req-e2e53a3a-9f36-4387-afe7-13ebeab82efa service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Received event network-changed-d5b95762-5800-49c5-9cf1-f8582b17c337 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-2166b5d0-a361-4e82-a98d-53ab914a583e req-e2e53a3a-9f36-4387-afe7-13ebeab82efa service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Refreshing instance network info cache due to event network-changed-d5b95762-5800-49c5-9cf1-f8582b17c337. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2166b5d0-a361-4e82-a98d-53ab914a583e req-e2e53a3a-9f36-4387-afe7-13ebeab82efa service nova] Acquiring lock "refresh_cache-4d1f0f1d-f55f-4aa3-b642-512ff95b5955" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Updating instance_info_cache with network_info: [{"id": "d5b95762-5800-49c5-9cf1-f8582b17c337", "address": "fa:16:3e:70:5f:c6", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b95762-58", "ovs_interfaceid": "d5b95762-5800-49c5-9cf1-f8582b17c337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Releasing lock "refresh_cache-4d1f0f1d-f55f-4aa3-b642-512ff95b5955" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Instance network_info: |[{"id": "d5b95762-5800-49c5-9cf1-f8582b17c337", "address": "fa:16:3e:70:5f:c6", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b95762-58", "ovs_interfaceid": "d5b95762-5800-49c5-9cf1-f8582b17c337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2166b5d0-a361-4e82-a98d-53ab914a583e req-e2e53a3a-9f36-4387-afe7-13ebeab82efa service nova] Acquired lock "refresh_cache-4d1f0f1d-f55f-4aa3-b642-512ff95b5955" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.network.neutron [req-2166b5d0-a361-4e82-a98d-53ab914a583e req-e2e53a3a-9f36-4387-afe7-13ebeab82efa service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Refreshing network info cache for port d5b95762-5800-49c5-9cf1-f8582b17c337 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Start _get_guest_xml network_info=[{"id": "d5b95762-5800-49c5-9cf1-f8582b17c337", "address": "fa:16:3e:70:5f:c6", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b95762-58", "ovs_interfaceid": "d5b95762-5800-49c5-9cf1-f8582b17c337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:11:01 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:11:01 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2046194636',display_name='tempest-VolumesSnapshotTestJSON-instance-2046194636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2046194636',id=39,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBtf4jd1XSZOI1au8dbFM9qNlSm3HyCqG5LxzlmsQp2/1YBKzM0Xk7eRBOSYJBcC4xLMz+T9Ay17oSMSV+rGbyxoKa8Eithlc+UmeriAksPtESbX9kGUHazez+72XeMjg==',key_name='tempest-keypair-502977460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d837d09a38d4d97a262d1ca77c00134',ramdisk_id='',reservation_id='r-euc8pa7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-30442452',owner_user_name='tempest-VolumesSnapshotTestJSON-30442452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b344ee6f91744dd79f8a884a9212da6b',uuid=4d1f0f1d-f55f-4aa3-b642-512ff95b5955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5b95762-5800-49c5-9cf1-f8582b17c337", "address": "fa:16:3e:70:5f:c6", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b95762-58", "ovs_interfaceid": "d5b95762-5800-49c5-9cf1-f8582b17c337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Converting VIF {"id": "d5b95762-5800-49c5-9cf1-f8582b17c337", "address": "fa:16:3e:70:5f:c6", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b95762-58", "ovs_interfaceid": "d5b95762-5800-49c5-9cf1-f8582b17c337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:5f:c6,bridge_name='br-int',has_traffic_filtering=True,id=d5b95762-5800-49c5-9cf1-f8582b17c337,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b95762-58') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:11:01 user nova-compute[72815]:   <uuid>4d1f0f1d-f55f-4aa3-b642-512ff95b5955</uuid>
Aug 17 20:11:01 user nova-compute[72815]:   <name>instance-00000027</name>
Aug 17 20:11:01 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:11:01 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:11:01 user nova-compute[72815]:   <metadata>
Aug 17 20:11:01 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:11:01 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:11:01 user nova-compute[72815]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2046194636</nova:name>
Aug 17 20:11:01 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:11:01</nova:creationTime>
Aug 17 20:11:01 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:11:01 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:11:01 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:11:01 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:11:01 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:11:01 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:11:01 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:11:01 user nova-compute[72815]:       <nova:owner>
Aug 17 20:11:01 user nova-compute[72815]:         <nova:user uuid="b344ee6f91744dd79f8a884a9212da6b">tempest-VolumesSnapshotTestJSON-30442452-project-member</nova:user>
Aug 17 20:11:01 user nova-compute[72815]:         <nova:project uuid="2d837d09a38d4d97a262d1ca77c00134">tempest-VolumesSnapshotTestJSON-30442452</nova:project>
Aug 17 20:11:01 user nova-compute[72815]:       </nova:owner>
Aug 17 20:11:01 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:11:01 user nova-compute[72815]:       <nova:ports>
Aug 17 20:11:01 user nova-compute[72815]:         <nova:port uuid="d5b95762-5800-49c5-9cf1-f8582b17c337">
Aug 17 20:11:01 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 20:11:01 user nova-compute[72815]:         </nova:port>
Aug 17 20:11:01 user nova-compute[72815]:       </nova:ports>
Aug 17 20:11:01 user nova-compute[72815]:     </nova:instance>
Aug 17 20:11:01 user nova-compute[72815]:   </metadata>
Aug 17 20:11:01 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:11:01 user nova-compute[72815]:     <system>
Aug 17 20:11:01 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:11:01 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:11:01 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:11:01 user nova-compute[72815]:       <entry name="serial">4d1f0f1d-f55f-4aa3-b642-512ff95b5955</entry>
Aug 17 20:11:01 user nova-compute[72815]:       <entry name="uuid">4d1f0f1d-f55f-4aa3-b642-512ff95b5955</entry>
Aug 17 20:11:01 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:11:01 user nova-compute[72815]:     </system>
Aug 17 20:11:01 user nova-compute[72815]:   </sysinfo>
Aug 17 20:11:01 user nova-compute[72815]:   <os>
Aug 17 20:11:01 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:11:01 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:11:01 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:11:01 user nova-compute[72815]:   </os>
Aug 17 20:11:01 user nova-compute[72815]:   <features>
Aug 17 20:11:01 user nova-compute[72815]:     <acpi/>
Aug 17 20:11:01 user nova-compute[72815]:     <apic/>
Aug 17 20:11:01 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:11:01 user nova-compute[72815]:   </features>
Aug 17 20:11:01 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:11:01 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:11:01 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:11:01 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:11:01 user nova-compute[72815]:   </clock>
Aug 17 20:11:01 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:11:01 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:11:01 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:11:01 user nova-compute[72815]:   </cpu>
Aug 17 20:11:01 user nova-compute[72815]:   <devices>
Aug 17 20:11:01 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:11:01 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:11:01 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk"/>
Aug 17 20:11:01 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:11:01 user nova-compute[72815]:     </disk>
Aug 17 20:11:01 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:11:01 user nova-compute[72815]:       <mac address="fa:16:3e:70:5f:c6"/>
Aug 17 20:11:01 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:11:01 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:11:01 user nova-compute[72815]:       <target dev="tapd5b95762-58"/>
Aug 17 20:11:01 user nova-compute[72815]:     </interface>
Aug 17 20:11:01 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:11:01 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/console.log" append="off"/>
Aug 17 20:11:01 user nova-compute[72815]:     </serial>
Aug 17 20:11:01 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:11:01 user nova-compute[72815]:     <video>
Aug 17 20:11:01 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:11:01 user nova-compute[72815]:     </video>
Aug 17 20:11:01 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:11:01 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:11:01 user nova-compute[72815]:     </rng>
Aug 17 20:11:01 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:11:01 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:11:01 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:11:01 user nova-compute[72815]:     </memballoon>
Aug 17 20:11:01 user nova-compute[72815]:   </devices>
Aug 17 20:11:01 user nova-compute[72815]: </domain>
Aug 17 20:11:01 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2046194636',display_name='tempest-VolumesSnapshotTestJSON-instance-2046194636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2046194636',id=39,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBtf4jd1XSZOI1au8dbFM9qNlSm3HyCqG5LxzlmsQp2/1YBKzM0Xk7eRBOSYJBcC4xLMz+T9Ay17oSMSV+rGbyxoKa8Eithlc+UmeriAksPtESbX9kGUHazez+72XeMjg==',key_name='tempest-keypair-502977460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d837d09a38d4d97a262d1ca77c00134',ramdisk_id='',reservation_id='r-euc8pa7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-30442452',owner_user_name='tempest-VolumesSnapshotTestJSON-30442452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b344ee6f91744dd79f8a884a9212da6b',uuid=4d1f0f1d-f55f-4aa3-b642-512ff95b5955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5b95762-5800-49c5-9cf1-f8582b17c337", "address": "fa:16:3e:70:5f:c6", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b95762-58", "ovs_interfaceid": "d5b95762-5800-49c5-9cf1-f8582b17c337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Converting VIF {"id": "d5b95762-5800-49c5-9cf1-f8582b17c337", "address": "fa:16:3e:70:5f:c6", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b95762-58", "ovs_interfaceid": "d5b95762-5800-49c5-9cf1-f8582b17c337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:5f:c6,bridge_name='br-int',has_traffic_filtering=True,id=d5b95762-5800-49c5-9cf1-f8582b17c337,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b95762-58') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG os_vif [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:5f:c6,bridge_name='br-int',has_traffic_filtering=True,id=d5b95762-5800-49c5-9cf1-f8582b17c337,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b95762-58') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5b95762-58, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5b95762-58, col_values=(('external_ids', {'iface-id': 'd5b95762-5800-49c5-9cf1-f8582b17c337', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:5f:c6', 'vm-uuid': '4d1f0f1d-f55f-4aa3-b642-512ff95b5955'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:01 user nova-compute[72815]: INFO os_vif [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:5f:c6,bridge_name='br-int',has_traffic_filtering=True,id=d5b95762-5800-49c5-9cf1-f8582b17c337,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b95762-58')
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] No VIF found with MAC fa:16:3e:70:5f:c6, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:11:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:02 user nova-compute[72815]: DEBUG nova.network.neutron [req-2166b5d0-a361-4e82-a98d-53ab914a583e req-e2e53a3a-9f36-4387-afe7-13ebeab82efa service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Updated VIF entry in instance network info cache for port d5b95762-5800-49c5-9cf1-f8582b17c337. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:11:02 user nova-compute[72815]: DEBUG nova.network.neutron [req-2166b5d0-a361-4e82-a98d-53ab914a583e req-e2e53a3a-9f36-4387-afe7-13ebeab82efa service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Updating instance_info_cache with network_info: [{"id": "d5b95762-5800-49c5-9cf1-f8582b17c337", "address": "fa:16:3e:70:5f:c6", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b95762-58", "ovs_interfaceid": "d5b95762-5800-49c5-9cf1-f8582b17c337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:11:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2166b5d0-a361-4e82-a98d-53ab914a583e req-e2e53a3a-9f36-4387-afe7-13ebeab82efa service nova] Releasing lock "refresh_cache-4d1f0f1d-f55f-4aa3-b642-512ff95b5955" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:11:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-ec624a90-2d3f-4d4a-968b-dd75f3a3cc3c req-53451ce9-ccb1-49df-bd2b-66686f1e26cb service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Received event network-vif-plugged-d5b95762-5800-49c5-9cf1-f8582b17c337 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ec624a90-2d3f-4d4a-968b-dd75f3a3cc3c req-53451ce9-ccb1-49df-bd2b-66686f1e26cb service nova] Acquiring lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ec624a90-2d3f-4d4a-968b-dd75f3a3cc3c req-53451ce9-ccb1-49df-bd2b-66686f1e26cb service nova] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ec624a90-2d3f-4d4a-968b-dd75f3a3cc3c req-53451ce9-ccb1-49df-bd2b-66686f1e26cb service nova] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-ec624a90-2d3f-4d4a-968b-dd75f3a3cc3c req-53451ce9-ccb1-49df-bd2b-66686f1e26cb service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] No waiting events found dispatching network-vif-plugged-d5b95762-5800-49c5-9cf1-f8582b17c337 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:11:03 user nova-compute[72815]: WARNING nova.compute.manager [req-ec624a90-2d3f-4d4a-968b-dd75f3a3cc3c req-53451ce9-ccb1-49df-bd2b-66686f1e26cb service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Received unexpected event network-vif-plugged-d5b95762-5800-49c5-9cf1-f8582b17c337 for instance with vm_state building and task_state spawning.
Aug 17 20:11:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303065.2474856, 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:11:05 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] VM Resumed (Lifecycle Event)
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:11:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Instance spawned successfully.
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:11:05 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303065.2493355, 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:11:05 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] VM Started (Lifecycle Event)
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:05 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:11:05 user nova-compute[72815]: INFO nova.compute.manager [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:11:05 user nova-compute[72815]: INFO nova.compute.manager [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Took 6.73 seconds to build instance.
Aug 17 20:11:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0eb56907-1102-47ff-bee5-1318826fc945 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.853s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:11:05 user nova-compute[72815]: INFO nova.compute.claims [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Claim successful on node user
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-3f2a7c0a-c21c-45da-a7f3-59b9370ab31a req-f2fcde17-592d-4f8b-9698-d1c2621bed01 service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Received event network-vif-plugged-d5b95762-5800-49c5-9cf1-f8582b17c337 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3f2a7c0a-c21c-45da-a7f3-59b9370ab31a req-f2fcde17-592d-4f8b-9698-d1c2621bed01 service nova] Acquiring lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3f2a7c0a-c21c-45da-a7f3-59b9370ab31a req-f2fcde17-592d-4f8b-9698-d1c2621bed01 service nova] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3f2a7c0a-c21c-45da-a7f3-59b9370ab31a req-f2fcde17-592d-4f8b-9698-d1c2621bed01 service nova] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-3f2a7c0a-c21c-45da-a7f3-59b9370ab31a req-f2fcde17-592d-4f8b-9698-d1c2621bed01 service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] No waiting events found dispatching network-vif-plugged-d5b95762-5800-49c5-9cf1-f8582b17c337 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:11:05 user nova-compute[72815]: WARNING nova.compute.manager [req-3f2a7c0a-c21c-45da-a7f3-59b9370ab31a req-f2fcde17-592d-4f8b-9698-d1c2621bed01 service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Received unexpected event network-vif-plugged-d5b95762-5800-49c5-9cf1-f8582b17c337 for instance with vm_state active and task_state None.
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:11:06 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:11:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:11:06 user nova-compute[72815]: DEBUG nova.network.neutron [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:11:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:11:06 user nova-compute[72815]: DEBUG nova.policy [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '577ed0692a254a2fbd518e258563447f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78ad2cbee8e4db892ab66d619e0e42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:11:06 user nova-compute[72815]: INFO nova.virt.block_device [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Booting with volume snapshot 9509ad6d-8f89-4c52-9042-7adec42eea54 at /dev/vda
Aug 17 20:11:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:06 user nova-compute[72815]: DEBUG nova.network.neutron [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Successfully created port: 9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:11:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Successfully updated port: 9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:11:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "refresh_cache-167eb80d-4ac2-4b82-b3ab-897ac91247f2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:11:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquired lock "refresh_cache-167eb80d-4ac2-4b82-b3ab-897ac91247f2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:11:07 user nova-compute[72815]: DEBUG nova.network.neutron [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:11:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-02bf64dd-8a84-4553-b763-3e6fa622c33f req-d42b1d1f-8e3d-4352-8dca-8c4d7e3bb404 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Received event network-changed-9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-02bf64dd-8a84-4553-b763-3e6fa622c33f req-d42b1d1f-8e3d-4352-8dca-8c4d7e3bb404 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Refreshing instance network info cache due to event network-changed-9e4528ff-8473-4b16-90f7-d204b176cee2. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:11:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-02bf64dd-8a84-4553-b763-3e6fa622c33f req-d42b1d1f-8e3d-4352-8dca-8c4d7e3bb404 service nova] Acquiring lock "refresh_cache-167eb80d-4ac2-4b82-b3ab-897ac91247f2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:11:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:11:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Updating instance_info_cache with network_info: [{"id": "9e4528ff-8473-4b16-90f7-d204b176cee2", "address": "fa:16:3e:dc:4d:0b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4528ff-84", "ovs_interfaceid": "9e4528ff-8473-4b16-90f7-d204b176cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:11:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Releasing lock "refresh_cache-167eb80d-4ac2-4b82-b3ab-897ac91247f2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:11:08 user nova-compute[72815]: DEBUG nova.compute.manager [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Instance network_info: |[{"id": "9e4528ff-8473-4b16-90f7-d204b176cee2", "address": "fa:16:3e:dc:4d:0b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4528ff-84", "ovs_interfaceid": "9e4528ff-8473-4b16-90f7-d204b176cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:11:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-02bf64dd-8a84-4553-b763-3e6fa622c33f req-d42b1d1f-8e3d-4352-8dca-8c4d7e3bb404 service nova] Acquired lock "refresh_cache-167eb80d-4ac2-4b82-b3ab-897ac91247f2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:11:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-02bf64dd-8a84-4553-b763-3e6fa622c33f req-d42b1d1f-8e3d-4352-8dca-8c4d7e3bb404 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Refreshing network info cache for port 9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:11:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-02bf64dd-8a84-4553-b763-3e6fa622c33f req-d42b1d1f-8e3d-4352-8dca-8c4d7e3bb404 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Updated VIF entry in instance network info cache for port 9e4528ff-8473-4b16-90f7-d204b176cee2. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:11:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-02bf64dd-8a84-4553-b763-3e6fa622c33f req-d42b1d1f-8e3d-4352-8dca-8c4d7e3bb404 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Updating instance_info_cache with network_info: [{"id": "9e4528ff-8473-4b16-90f7-d204b176cee2", "address": "fa:16:3e:dc:4d:0b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4528ff-84", "ovs_interfaceid": "9e4528ff-8473-4b16-90f7-d204b176cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:11:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-02bf64dd-8a84-4553-b763-3e6fa622c33f req-d42b1d1f-8e3d-4352-8dca-8c4d7e3bb404 service nova] Releasing lock "refresh_cache-167eb80d-4ac2-4b82-b3ab-897ac91247f2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:11:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG os_brick.utils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[97341d82-fd34-4b4f-93cd-ceb1dd555915]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[79196cc0-fca2-4c64-b7e8-abeb1af27c5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[37295970-5c86-4043-bfb7-dd0c2ead20aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[217a2459-81b5-4699-b75e-f529ae335cdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:11:12 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:11:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ffc819-08bf-4521-8e10-ce5032c5b786]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG os_brick.utils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:11:12 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Updating existing volume attachment record: a835f310-228c-42db-b446-52bcab85516e {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:11:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG nova.objects.instance [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'flavor' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:18 user nova-compute[72815]: INFO nova.compute.manager [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Attaching volume ca673eca-f558-4672-bac3-25a0a04e6c45 to /dev/vdb
Aug 17 20:11:18 user nova-compute[72815]: DEBUG os_brick.utils [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9303fdd1-bbb4-4063-8ba9-6b2dc5be93e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c05e2a-4029-4929-a122-22b2e1a60e86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[815e830d-030c-4f8e-a93f-ed0d037c33d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f959a04-ee61-4156-9527-1ae344e89bd9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:11:19 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:11:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f5cb5d-699d-472f-b768-7b3bec754d88]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG os_brick.utils [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:11:19 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updating existing volume attachment record: bbd0fe71-2f40-41c2-9bc6-0827f6e14930 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:11:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.compute.manager [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:11:24 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Creating image(s)
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Ensure instance console log exists: /opt/stack/data/nova/instances/167eb80d-4ac2-4b82-b3ab-897ac91247f2/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Start _get_guest_xml network_info=[{"id": "9e4528ff-8473-4b16-90f7-d204b176cee2", "address": "fa:16:3e:dc:4d:0b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4528ff-84", "ovs_interfaceid": "9e4528ff-8473-4b16-90f7-d204b176cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T20:10:55Z,direct_url=<?>,disk_format='qcow2',id=9e340a8b-d58e-4e56-aed3-b90f530613c1,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-648184029',owner='a78ad2cbee8e4db892ab66d619e0e42e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T20:10:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': 'a835f310-228c-42db-b446-52bcab85516e', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVuNiLqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '167eb80d-4ac2-4b82-b3ab-897ac91247f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'da334dde-d96a-4550-9235-ca24be554e4d', 'serial': 'da334dde-d96a-4550-9235-ca24be554e4d'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:11:24 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:11:24 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T20:10:55Z,direct_url=<?>,disk_format='qcow2',id=9e340a8b-d58e-4e56-aed3-b90f530613c1,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-648184029',owner='a78ad2cbee8e4db892ab66d619e0e42e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T20:10:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVuNiLqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:11:24 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:11:24 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:11:24 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a492b7b-d35d-46b9-ae49-17ebec2e7292]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:11:24 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[658cb7b5-5842-4ed4-95a9-f7ec2e4eabcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d] added
Aug 17 20:11:24 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b463d8b-29ea-4a2d-829e-06d688cf9fe5]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbe5636-f1a6-40b4-bbac-143670219bec]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xVuNiLqz {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xVuNiLqz" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8e9739-7ced-4753-b2b3-e0b45e04b645]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xVuNiLqz'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b020808a-1248-448e-864a-c70151c91884]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f398fee3-85e2-4363-b173-b1d4b323452e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:11:24 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:11:24 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f97a56-578a-4594-9f35-26d69d500146]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d, portal: 172.16.0.220,3260]
Aug 17 20:11:24 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d, portal: 172.16.0.220,3260] successful.
Aug 17 20:11:24 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[947e1165-d810-4c7a-9fe3-f2b6ada8e711]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e9fe80-7545-4683-a251-df5b69e72773]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:11:24 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:11:24 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:11:24 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6960a278-47be-4582-9e8b-97e7bac96641]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:11:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVuNiLqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23336336434333461', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336336434333461', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:11:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-928679878',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-928679878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-928679878',id=40,image_ref='9e340a8b-d58e-4e56-aed3-b90f530613c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlxamuUfxZN5MraL5JaxpuYbxc7bi6jV+uxxWVdzOAUnPkjYlCe0MXEJ2AkUtEZ/UYUBzTFo/P9JN+JCvUQrVWYQT1GLYxM/spmlesbypvBftcF4+sVsPE/2MFFQcY/0Q==',key_name='tempest-keypair-1197686493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-uzo94qf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-781314261',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:11:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577ed0692a254a2fbd518e258563447f',uuid=167eb80d-4ac2-4b82-b3ab-897ac91247f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e4528ff-8473-4b16-90f7-d204b176cee2", "address": "fa:16:3e:dc:4d:0b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4528ff-84", "ovs_interfaceid": "9e4528ff-8473-4b16-90f7-d204b176cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "9e4528ff-8473-4b16-90f7-d204b176cee2", "address": "fa:16:3e:dc:4d:0b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4528ff-84", "ovs_interfaceid": "9e4528ff-8473-4b16-90f7-d204b176cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:0b,bridge_name='br-int',has_traffic_filtering=True,id=9e4528ff-8473-4b16-90f7-d204b176cee2,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4528ff-84') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG nova.objects.instance [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lazy-loading 'pci_devices' on Instance uuid 167eb80d-4ac2-4b82-b3ab-897ac91247f2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:11:25 user nova-compute[72815]:   <uuid>167eb80d-4ac2-4b82-b3ab-897ac91247f2</uuid>
Aug 17 20:11:25 user nova-compute[72815]:   <name>instance-00000028</name>
Aug 17 20:11:25 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:11:25 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:11:25 user nova-compute[72815]:   <metadata>
Aug 17 20:11:25 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:11:25 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:11:25 user nova-compute[72815]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-928679878</nova:name>
Aug 17 20:11:25 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:11:24</nova:creationTime>
Aug 17 20:11:25 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:11:25 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:11:25 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:11:25 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:11:25 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:11:25 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:11:25 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:11:25 user nova-compute[72815]:       <nova:owner>
Aug 17 20:11:25 user nova-compute[72815]:         <nova:user uuid="577ed0692a254a2fbd518e258563447f">tempest-TestVolumeBootPattern-781314261-project-member</nova:user>
Aug 17 20:11:25 user nova-compute[72815]:         <nova:project uuid="a78ad2cbee8e4db892ab66d619e0e42e">tempest-TestVolumeBootPattern-781314261</nova:project>
Aug 17 20:11:25 user nova-compute[72815]:       </nova:owner>
Aug 17 20:11:25 user nova-compute[72815]:       <nova:root type="image" uuid="9e340a8b-d58e-4e56-aed3-b90f530613c1"/>
Aug 17 20:11:25 user nova-compute[72815]:       <nova:ports>
Aug 17 20:11:25 user nova-compute[72815]:         <nova:port uuid="9e4528ff-8473-4b16-90f7-d204b176cee2">
Aug 17 20:11:25 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 20:11:25 user nova-compute[72815]:         </nova:port>
Aug 17 20:11:25 user nova-compute[72815]:       </nova:ports>
Aug 17 20:11:25 user nova-compute[72815]:     </nova:instance>
Aug 17 20:11:25 user nova-compute[72815]:   </metadata>
Aug 17 20:11:25 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:11:25 user nova-compute[72815]:     <system>
Aug 17 20:11:25 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:11:25 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:11:25 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:11:25 user nova-compute[72815]:       <entry name="serial">167eb80d-4ac2-4b82-b3ab-897ac91247f2</entry>
Aug 17 20:11:25 user nova-compute[72815]:       <entry name="uuid">167eb80d-4ac2-4b82-b3ab-897ac91247f2</entry>
Aug 17 20:11:25 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:11:25 user nova-compute[72815]:     </system>
Aug 17 20:11:25 user nova-compute[72815]:   </sysinfo>
Aug 17 20:11:25 user nova-compute[72815]:   <os>
Aug 17 20:11:25 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:11:25 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:11:25 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:11:25 user nova-compute[72815]:   </os>
Aug 17 20:11:25 user nova-compute[72815]:   <features>
Aug 17 20:11:25 user nova-compute[72815]:     <acpi/>
Aug 17 20:11:25 user nova-compute[72815]:     <apic/>
Aug 17 20:11:25 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:11:25 user nova-compute[72815]:   </features>
Aug 17 20:11:25 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:11:25 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:11:25 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:11:25 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:11:25 user nova-compute[72815]:   </clock>
Aug 17 20:11:25 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:11:25 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:11:25 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:11:25 user nova-compute[72815]:   </cpu>
Aug 17 20:11:25 user nova-compute[72815]:   <devices>
Aug 17 20:11:25 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:11:25 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:11:25 user nova-compute[72815]:       <source dev="/dev/sdb"/>
Aug 17 20:11:25 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:11:25 user nova-compute[72815]:       <serial>da334dde-d96a-4550-9235-ca24be554e4d</serial>
Aug 17 20:11:25 user nova-compute[72815]:     </disk>
Aug 17 20:11:25 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:11:25 user nova-compute[72815]:       <mac address="fa:16:3e:dc:4d:0b"/>
Aug 17 20:11:25 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:11:25 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:11:25 user nova-compute[72815]:       <target dev="tap9e4528ff-84"/>
Aug 17 20:11:25 user nova-compute[72815]:     </interface>
Aug 17 20:11:25 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:11:25 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/167eb80d-4ac2-4b82-b3ab-897ac91247f2/console.log" append="off"/>
Aug 17 20:11:25 user nova-compute[72815]:     </serial>
Aug 17 20:11:25 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:11:25 user nova-compute[72815]:     <video>
Aug 17 20:11:25 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:11:25 user nova-compute[72815]:     </video>
Aug 17 20:11:25 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:11:25 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:11:25 user nova-compute[72815]:     </rng>
Aug 17 20:11:25 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:11:25 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:11:25 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:11:25 user nova-compute[72815]:     </memballoon>
Aug 17 20:11:25 user nova-compute[72815]:   </devices>
Aug 17 20:11:25 user nova-compute[72815]: </domain>
Aug 17 20:11:25 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:11:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-928679878',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-928679878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-928679878',id=40,image_ref='9e340a8b-d58e-4e56-aed3-b90f530613c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlxamuUfxZN5MraL5JaxpuYbxc7bi6jV+uxxWVdzOAUnPkjYlCe0MXEJ2AkUtEZ/UYUBzTFo/P9JN+JCvUQrVWYQT1GLYxM/spmlesbypvBftcF4+sVsPE/2MFFQcY/0Q==',key_name='tempest-keypair-1197686493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-uzo94qf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-781314261',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:11:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577ed0692a254a2fbd518e258563447f',uuid=167eb80d-4ac2-4b82-b3ab-897ac91247f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e4528ff-8473-4b16-90f7-d204b176cee2", "address": "fa:16:3e:dc:4d:0b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4528ff-84", "ovs_interfaceid": "9e4528ff-8473-4b16-90f7-d204b176cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "9e4528ff-8473-4b16-90f7-d204b176cee2", "address": "fa:16:3e:dc:4d:0b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4528ff-84", "ovs_interfaceid": "9e4528ff-8473-4b16-90f7-d204b176cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:0b,bridge_name='br-int',has_traffic_filtering=True,id=9e4528ff-8473-4b16-90f7-d204b176cee2,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4528ff-84') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG os_vif [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:0b,bridge_name='br-int',has_traffic_filtering=True,id=9e4528ff-8473-4b16-90f7-d204b176cee2,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4528ff-84') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e4528ff-84, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e4528ff-84, col_values=(('external_ids', {'iface-id': '9e4528ff-8473-4b16-90f7-d204b176cee2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:4d:0b', 'vm-uuid': '167eb80d-4ac2-4b82-b3ab-897ac91247f2'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:25 user nova-compute[72815]: INFO os_vif [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:0b,bridge_name='br-int',has_traffic_filtering=True,id=9e4528ff-8473-4b16-90f7-d204b176cee2,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4528ff-84')
Aug 17 20:11:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:11:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] No VIF found with MAC fa:16:3e:dc:4d:0b, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:11:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:27 user nova-compute[72815]: DEBUG nova.compute.manager [req-2858220b-cd06-40aa-a4ff-f7f1694bb08b req-617345c5-aba8-4b56-bbce-279b55abd3a9 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Received event network-vif-plugged-9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2858220b-cd06-40aa-a4ff-f7f1694bb08b req-617345c5-aba8-4b56-bbce-279b55abd3a9 service nova] Acquiring lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2858220b-cd06-40aa-a4ff-f7f1694bb08b req-617345c5-aba8-4b56-bbce-279b55abd3a9 service nova] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2858220b-cd06-40aa-a4ff-f7f1694bb08b req-617345c5-aba8-4b56-bbce-279b55abd3a9 service nova] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:27 user nova-compute[72815]: DEBUG nova.compute.manager [req-2858220b-cd06-40aa-a4ff-f7f1694bb08b req-617345c5-aba8-4b56-bbce-279b55abd3a9 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] No waiting events found dispatching network-vif-plugged-9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:11:27 user nova-compute[72815]: WARNING nova.compute.manager [req-2858220b-cd06-40aa-a4ff-f7f1694bb08b req-617345c5-aba8-4b56-bbce-279b55abd3a9 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Received unexpected event network-vif-plugged-9e4528ff-8473-4b16-90f7-d204b176cee2 for instance with vm_state building and task_state spawning.
Aug 17 20:11:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:28 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303088.9434874, 167eb80d-4ac2-4b82-b3ab-897ac91247f2 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:11:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] VM Resumed (Lifecycle Event)
Aug 17 20:11:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:11:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:11:28 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Instance spawned successfully.
Aug 17 20:11:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:11:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:11:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:11:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:11:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:11:29 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303088.9449668, 167eb80d-4ac2-4b82-b3ab-897ac91247f2 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:11:29 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] VM Started (Lifecycle Event)
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:11:29 user nova-compute[72815]: INFO nova.compute.manager [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Took 4.92 seconds to spawn the instance on the hypervisor.
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:11:29 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "12a34846-1670-4c6c-ac7d-522530aaf3a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.009s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:29 user nova-compute[72815]: INFO nova.compute.manager [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Took 23.69 seconds to build instance.
Aug 17 20:11:29 user nova-compute[72815]: INFO nova.compute.manager [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Terminating instance
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.compute.manager [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.compute.manager [req-2492c4bb-82d6-4ce4-9baf-9a7582d7abfd req-381446e7-75b3-4e84-ae2c-96449e3205f9 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Received event network-vif-plugged-9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2492c4bb-82d6-4ce4-9baf-9a7582d7abfd req-381446e7-75b3-4e84-ae2c-96449e3205f9 service nova] Acquiring lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2492c4bb-82d6-4ce4-9baf-9a7582d7abfd req-381446e7-75b3-4e84-ae2c-96449e3205f9 service nova] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2492c4bb-82d6-4ce4-9baf-9a7582d7abfd req-381446e7-75b3-4e84-ae2c-96449e3205f9 service nova] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.compute.manager [req-2492c4bb-82d6-4ce4-9baf-9a7582d7abfd req-381446e7-75b3-4e84-ae2c-96449e3205f9 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] No waiting events found dispatching network-vif-plugged-9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:11:29 user nova-compute[72815]: WARNING nova.compute.manager [req-2492c4bb-82d6-4ce4-9baf-9a7582d7abfd req-381446e7-75b3-4e84-ae2c-96449e3205f9 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Received unexpected event network-vif-plugged-9e4528ff-8473-4b16-90f7-d204b176cee2 for instance with vm_state active and task_state None.
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-3927c47f-46a2-4911-b6db-6f1b5478878a tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.815s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.compute.manager [req-8e7357f2-2c2b-4260-922a-c7fd29f760b1 req-a6574726-4e8d-4550-ab5b-955cf7902ac8 service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Received event network-vif-unplugged-98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8e7357f2-2c2b-4260-922a-c7fd29f760b1 req-a6574726-4e8d-4550-ab5b-955cf7902ac8 service nova] Acquiring lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8e7357f2-2c2b-4260-922a-c7fd29f760b1 req-a6574726-4e8d-4550-ab5b-955cf7902ac8 service nova] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8e7357f2-2c2b-4260-922a-c7fd29f760b1 req-a6574726-4e8d-4550-ab5b-955cf7902ac8 service nova] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.compute.manager [req-8e7357f2-2c2b-4260-922a-c7fd29f760b1 req-a6574726-4e8d-4550-ab5b-955cf7902ac8 service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] No waiting events found dispatching network-vif-unplugged-98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.compute.manager [req-8e7357f2-2c2b-4260-922a-c7fd29f760b1 req-a6574726-4e8d-4550-ab5b-955cf7902ac8 service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Received event network-vif-unplugged-98f41342-7493-4985-8f61-152b56913ed4 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:29 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Instance destroyed successfully.
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.objects.instance [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'resources' on Instance uuid 12a34846-1670-4c6c-ac7d-522530aaf3a7 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-701913410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-701913410',id=24,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:02:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-ogwahb1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:04:02Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=12a34846-1670-4c6c-ac7d-522530aaf3a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98f41342-7493-4985-8f61-152b56913ed4", "address": "fa:16:3e:cd:16:2d", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f41342-74", "ovs_interfaceid": "98f41342-7493-4985-8f61-152b56913ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "98f41342-7493-4985-8f61-152b56913ed4", "address": "fa:16:3e:cd:16:2d", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f41342-74", "ovs_interfaceid": "98f41342-7493-4985-8f61-152b56913ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=98f41342-7493-4985-8f61-152b56913ed4,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f41342-74') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG os_vif [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=98f41342-7493-4985-8f61-152b56913ed4,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f41342-74') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98f41342-74, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:29 user nova-compute[72815]: INFO os_vif [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=98f41342-7493-4985-8f61-152b56913ed4,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f41342-74')
Aug 17 20:11:29 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Deleting instance files /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7_del
Aug 17 20:11:29 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Deletion of /opt/stack/data/nova/instances/12a34846-1670-4c6c-ac7d-522530aaf3a7_del complete
Aug 17 20:11:29 user nova-compute[72815]: INFO nova.compute.manager [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 17 20:11:29 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:11:29 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:11:30 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:11:30 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Took 0.50 seconds to deallocate network for instance.
Aug 17 20:11:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:30 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:11:30 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:11:30 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:11:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:30 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Deleted allocations for instance 12a34846-1670-4c6c-ac7d-522530aaf3a7
Aug 17 20:11:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-01ab013f-a9b7-41a5-87f3-533317106829 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.928s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-9dc8cb09-a87b-46bb-9f32-ef96f3b9701c req-6eb021fb-9d1a-411b-8d8b-1f915cb9df22 service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Received event network-vif-deleted-98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-654831c7-b506-40cf-a994-ce899105b7cb req-a389f25f-1a56-4ebc-9e9a-27d9b752254e service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Received event network-vif-plugged-98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-654831c7-b506-40cf-a994-ce899105b7cb req-a389f25f-1a56-4ebc-9e9a-27d9b752254e service nova] Acquiring lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-654831c7-b506-40cf-a994-ce899105b7cb req-a389f25f-1a56-4ebc-9e9a-27d9b752254e service nova] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:31 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-654831c7-b506-40cf-a994-ce899105b7cb req-a389f25f-1a56-4ebc-9e9a-27d9b752254e service nova] Lock "12a34846-1670-4c6c-ac7d-522530aaf3a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:31 user nova-compute[72815]: DEBUG nova.compute.manager [req-654831c7-b506-40cf-a994-ce899105b7cb req-a389f25f-1a56-4ebc-9e9a-27d9b752254e service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] No waiting events found dispatching network-vif-plugged-98f41342-7493-4985-8f61-152b56913ed4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:11:31 user nova-compute[72815]: WARNING nova.compute.manager [req-654831c7-b506-40cf-a994-ce899105b7cb req-a389f25f-1a56-4ebc-9e9a-27d9b752254e service nova] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Received unexpected event network-vif-plugged-98f41342-7493-4985-8f61-152b56913ed4 for instance with vm_state deleted and task_state None.
Aug 17 20:11:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:33 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:11:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:11:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:11:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkNcQrhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:11:35 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:11:35 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:11:35 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf94a88-c29b-435b-b666-d606059ea6ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:11:35 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc70c99c-a4fe-4600-9507-908723f5f3d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45] added
Aug 17 20:11:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fffed2c-0ac3-4996-909c-39e29b41e6fb]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dda9b96-a443-4b4c-8e12-da741a2dae4f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jkNcQrhL {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jkNcQrhL" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f44a40-3058-438d-a193-70c07228beac]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jkNcQrhL'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee43a5b-a0d6-4a4d-8f79-29cf2ca3c5be]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[891f81ad-025d-425b-878b-cfd8e443b524]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:11:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:11:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4527e7-3d68-4403-9b55-c6be547fefe9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45, portal: 172.16.0.220,3260]
Aug 17 20:11:35 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45, portal: 172.16.0.220,3260] successful.
Aug 17 20:11:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67dc298-43ce-4445-8695-a7ae17b45e8f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42bc088-7e77-4c5c-a690-627b52cfc784]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 (non-flash)
Aug 17 20:11:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:11:35 user nova-compute[72815]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 (non-flash)
Aug 17 20:11:35 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b8df42-06b7-4293-9efc-4216cf9259a5]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkNcQrhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23039336562356337', 'path': '/dev/sdf'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039336562356337', 'path': '/dev/sdf'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG nova.objects.instance [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'flavor' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:11:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:11:37 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:11:37 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 20:11:37 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:11:37 user nova-compute[72815]:   <serial>ca673eca-f558-4672-bac3-25a0a04e6c45</serial>
Aug 17 20:11:37 user nova-compute[72815]: </disk>
Aug 17 20:11:37 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] No VIF found with MAC fa:16:3e:29:77:f9, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b078c0ef-401f-4069-afb5-766c627b15ad tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.769s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:11:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:11:38 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:11:38 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:11:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=6857MB free_disk=25.1942138671875GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:11:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ac6faff5-9700-4504-81d8-8ba2ab64d85f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 8ac64ac9-a49d-4c70-956b-3a140da5ede8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 4c630764-4e1b-4bab-b354-1389cd60f5a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 99693a7e-71e3-4543-b649-41a147c77c7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance e7e09061-f65f-444b-98f6-409da28295e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 62614d4a-13bb-4c75-8f84-c47bdbf7b024 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance b4462060-b172-4a3b-b9ed-d6b8514c8d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 167eb80d-4ac2-4b82-b3ab-897ac91247f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:39 user nova-compute[72815]: INFO nova.compute.manager [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Detaching volume ca673eca-f558-4672-bac3-25a0a04e6c45
Aug 17 20:11:39 user nova-compute[72815]: INFO nova.virt.block_device [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Attempting to driver detach volume ca673eca-f558-4672-bac3-25a0a04e6c45 from mountpoint /dev/vdb
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Attempting to detach device vdb from instance 99693a7e-71e3-4543-b649-41a147c77c7e from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:11:39 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:11:39 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 20:11:39 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:11:39 user nova-compute[72815]:   <serial>ca673eca-f558-4672-bac3-25a0a04e6c45</serial>
Aug 17 20:11:39 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:11:39 user nova-compute[72815]: </disk>
Aug 17 20:11:39 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:11:39 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Successfully detached device vdb from instance 99693a7e-71e3-4543-b649-41a147c77c7e from the persistent domain config.
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99693a7e-71e3-4543-b649-41a147c77c7e from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:11:39 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:11:39 user nova-compute[72815]:   <source dev="/dev/sdf"/>
Aug 17 20:11:39 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:11:39 user nova-compute[72815]:   <serial>ca673eca-f558-4672-bac3-25a0a04e6c45</serial>
Aug 17 20:11:39 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:11:39 user nova-compute[72815]: </disk>
Aug 17 20:11:39 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:11:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692303100.2081187, 99693a7e-71e3-4543-b649-41a147c77c7e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:11:40 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Successfully detached device vdb from instance 99693a7e-71e3-4543-b649-41a147c77c7e from the live domain config.
Aug 17 20:11:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkNcQrhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:11:40 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[efef26af-1360-4629-b194-f7b5b0ebb081]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cacda9d-b849-4da4-9c47-18490591a6ae]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:11:40 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:11:40 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:11:40 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:11:40 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:11:40 user nova-compute[72815]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 (non-flash)
Aug 17 20:11:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:11:40 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:11:40 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:11:40 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:11:40 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:11:40 user nova-compute[72815]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 (non-flash)
Aug 17 20:11:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399432e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45'): ({'sdf'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Removing single pathed devices sdf {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f37a34-eca7-4de1-9cd0-83f228a0d750]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc2f5c3-f6c3-4ee4-a93c-d9a60d1e0b04]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Flushing IO for device /dev/sdf {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73d0f63-78e1-45d2-b221-45051262e481]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d9c820-16e2-4055-ae52-f295a753a771]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] SCSI volumes sdf have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[770a70a7-4566-49f0-b6e2-5f1f95f65cfc]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[788b5896-bf8f-49e1-be16-49b6cfea9b7e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45, portal: 172.16.0.220,3260]
Aug 17 20:11:40 user nova-compute[72815]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45, portal: 172.16.0.220,3260] successful.
Aug 17 20:11:40 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca673eca-f558-4672-bac3-25a0a04e6c45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9a5301-7f98-489e-bafc-455b7e3be054]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] <== disconnect_volume: return (300ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:11:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:11:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'flavor' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:11:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-a4b9e49f-9325-4808-b953-0468492e8d0d tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.715s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:11:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:11:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:11:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:11:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:11:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:42 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Updating instance_info_cache with network_info: [{"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:11:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:11:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:11:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:11:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:11:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:11:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:11:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:11:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:11:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:11:44 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303089.7531157, 12a34846-1670-4c6c-ac7d-522530aaf3a7 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:11:44 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] VM Stopped (Lifecycle Event)
Aug 17 20:11:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-54943604-4572-418e-a642-e999672d7f34 None None] [instance: 12a34846-1670-4c6c-ac7d-522530aaf3a7] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:11:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:44 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:11:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:45 user nova-compute[72815]: INFO nova.compute.manager [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Terminating instance
Aug 17 20:11:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:11:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-759f971f-7a98-40da-8a5e-314e2830a318 req-848b03c0-a709-49c9-9a69-f6441494bbdf service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-vif-unplugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-759f971f-7a98-40da-8a5e-314e2830a318 req-848b03c0-a709-49c9-9a69-f6441494bbdf service nova] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-759f971f-7a98-40da-8a5e-314e2830a318 req-848b03c0-a709-49c9-9a69-f6441494bbdf service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-759f971f-7a98-40da-8a5e-314e2830a318 req-848b03c0-a709-49c9-9a69-f6441494bbdf service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-759f971f-7a98-40da-8a5e-314e2830a318 req-848b03c0-a709-49c9-9a69-f6441494bbdf service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] No waiting events found dispatching network-vif-unplugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-759f971f-7a98-40da-8a5e-314e2830a318 req-848b03c0-a709-49c9-9a69-f6441494bbdf service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-vif-unplugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:11:46 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Instance destroyed successfully.
Aug 17 20:11:46 user nova-compute[72815]: DEBUG nova.objects.instance [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lazy-loading 'resources' on Instance uuid 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T20:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-592611439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-592611439',id=31,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCNKJMEO1Iytsf6/eVE9Y1d1Ku4ylaFFaVwjCGf7SFQEDJ72TegDIOZqXt942HFg78gbDzYNttm/7+HntlcJ5blGKKCBKylGb8Q6G5S2YBjjsIScxsDUCsXsFIGuZTZKQ==',key_name='tempest-keypair-1811635152',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:10:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa140294f17e4751b13e2d4a15b17ff9',ramdisk_id='',reservation_id='r-08iiaggg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-632866040',owner_user_name='tempest-AttachVolumeShelveTestJSON-632866040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:10:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82d9b206cf4499eaf518f7cd6a7a10c',uuid=2ed62592-a25a-46cf-976a-5f2edbe6d5e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converting VIF {"id": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "address": "fa:16:3e:76:67:47", "network": {"id": "dc59b0e7-0296-4211-81f1-a3c1d1a694f4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-488265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa140294f17e4751b13e2d4a15b17ff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefc548f-4a", "ovs_interfaceid": "defc548f-4a74-4cdf-b1a8-12236dcf71e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG os_vif [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdefc548f-4a, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:11:46 user nova-compute[72815]: INFO os_vif [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:67:47,bridge_name='br-int',has_traffic_filtering=True,id=defc548f-4a74-4cdf-b1a8-12236dcf71e9,network=Network(dc59b0e7-0296-4211-81f1-a3c1d1a694f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefc548f-4a')
Aug 17 20:11:46 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Deleting instance files /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0_del
Aug 17 20:11:46 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Deletion of /opt/stack/data/nova/instances/2ed62592-a25a-46cf-976a-5f2edbe6d5e0_del complete
Aug 17 20:11:46 user nova-compute[72815]: INFO nova.compute.manager [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 20:11:46 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:11:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-29bd61ea-febd-4791-ac6c-d66b48f4bb6c req-4155cb9f-5670-40f1-8b33-b3e7c1f603c6 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-29bd61ea-febd-4791-ac6c-d66b48f4bb6c req-4155cb9f-5670-40f1-8b33-b3e7c1f603c6 service nova] Acquiring lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-29bd61ea-febd-4791-ac6c-d66b48f4bb6c req-4155cb9f-5670-40f1-8b33-b3e7c1f603c6 service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-29bd61ea-febd-4791-ac6c-d66b48f4bb6c req-4155cb9f-5670-40f1-8b33-b3e7c1f603c6 service nova] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-29bd61ea-febd-4791-ac6c-d66b48f4bb6c req-4155cb9f-5670-40f1-8b33-b3e7c1f603c6 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] No waiting events found dispatching network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:11:48 user nova-compute[72815]: WARNING nova.compute.manager [req-29bd61ea-febd-4791-ac6c-d66b48f4bb6c req-4155cb9f-5670-40f1-8b33-b3e7c1f603c6 service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received unexpected event network-vif-plugged-defc548f-4a74-4cdf-b1a8-12236dcf71e9 for instance with vm_state active and task_state deleting.
Aug 17 20:11:48 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:11:48 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Took 1.65 seconds to deallocate network for instance.
Aug 17 20:11:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-b5b060f0-b632-4cfd-a111-64f471179c6d req-d4582095-d730-471f-a374-40caddff9e0a service nova] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Received event network-vif-deleted-defc548f-4a74-4cdf-b1a8-12236dcf71e9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:48 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:11:48 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:11:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:48 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Deleted allocations for instance 2ed62592-a25a-46cf-976a-5f2edbe6d5e0
Aug 17 20:11:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-de987bfc-b5da-4115-912b-79a551bcb116 tempest-AttachVolumeShelveTestJSON-632866040 tempest-AttachVolumeShelveTestJSON-632866040-project-member] Lock "2ed62592-a25a-46cf-976a-5f2edbe6d5e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.064s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:54 user nova-compute[72815]: INFO nova.compute.manager [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Terminating instance
Aug 17 20:11:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-f839e8d7-a2b2-465e-b4be-117e278ef345 req-7da5f071-654b-45a5-9f9e-2b9ee3a5dd67 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received event network-vif-unplugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f839e8d7-a2b2-465e-b4be-117e278ef345 req-7da5f071-654b-45a5-9f9e-2b9ee3a5dd67 service nova] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f839e8d7-a2b2-465e-b4be-117e278ef345 req-7da5f071-654b-45a5-9f9e-2b9ee3a5dd67 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f839e8d7-a2b2-465e-b4be-117e278ef345 req-7da5f071-654b-45a5-9f9e-2b9ee3a5dd67 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-f839e8d7-a2b2-465e-b4be-117e278ef345 req-7da5f071-654b-45a5-9f9e-2b9ee3a5dd67 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] No waiting events found dispatching network-vif-unplugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-f839e8d7-a2b2-465e-b4be-117e278ef345 req-7da5f071-654b-45a5-9f9e-2b9ee3a5dd67 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received event network-vif-unplugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:54 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Instance destroyed successfully.
Aug 17 20:11:54 user nova-compute[72815]: DEBUG nova.objects.instance [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'resources' on Instance uuid 4c630764-4e1b-4bab-b354-1389cd60f5a5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:05:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-860044542',display_name='tempest-ServerActionsTestOtherA-server-860044542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-860044542',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4ENuaMW9sQVv3tRQvGXO2rdSecjVcsBbTS05/ZUuaQNEEpkOe2HF0EHrSzQ0+4hhL3IgPXmkF5ZxUJ6bIwwpVvvT5kiu8Xp5gaO6UacRTK/fZorahpTHXq4z54fcfMBQ==',key_name='tempest-keypair-1973140313',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-o2ttr69y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=4c630764-4e1b-4bab-b354-1389cd60f5a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "address": "fa:16:3e:27:4e:31", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eef4553-ca", "ovs_interfaceid": "8eef4553-caa7-4c0f-93f3-bef2adb15e66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG os_vif [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eef4553-ca, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:11:54 user nova-compute[72815]: INFO os_vif [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:4e:31,bridge_name='br-int',has_traffic_filtering=True,id=8eef4553-caa7-4c0f-93f3-bef2adb15e66,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eef4553-ca')
Aug 17 20:11:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytbPpMxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:11:54 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:11:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e30c11-1318-4af6-938a-8f8fac690bbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[164498c0-47fd-4518-be99-7520266e98d0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:11:54 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:11:54 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:11:54 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:11:54 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:11:54 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:11:54 user nova-compute[72815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 (non-flash)
Aug 17 20:11:54 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:11:54 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:11:54 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:11:54 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994348af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9'): ({'sdd'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Removing single pathed devices sdd {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8100f79-f899-47a2-a628-c40160d8e45b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[223a1951-4b33-47a0-b4b2-c064b3ab377e]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Flushing IO for device /dev/sdd {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e94c0f8-5c16-4fe0-849d-2877e5fa108b]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f04a6e-a7dc-4e4a-818f-6147183d7b27]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23165333239373766', '/dev/disk/by-id/scsi-1SCST_BIO36f7dc3d-1e32977f3b2a527f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_36f7dc3d') {{(pid=84269) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bbbf5a-8ccd-45a3-9283-82a8d0062a09]: (4, None) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08b9865-c69a-4c4b-b7e3-b4d1e5966f86]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8813d48e-d9cb-43bd-8573-82c1f3827969]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260]
Aug 17 20:11:55 user nova-compute[72815]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9, portal: 172.16.0.220,3260] successful.
Aug 17 20:11:55 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:228e179c-97dd-4ee6-978b-4450933aa2c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1521e6-c4ee-4181-b97a-7933e34d91c5]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] <== disconnect_volume: return (318ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:11:55 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Deleting instance files /opt/stack/data/nova/instances/4c630764-4e1b-4bab-b354-1389cd60f5a5_del
Aug 17 20:11:55 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Deletion of /opt/stack/data/nova/instances/4c630764-4e1b-4bab-b354-1389cd60f5a5_del complete
Aug 17 20:11:55 user nova-compute[72815]: INFO nova.compute.manager [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 17 20:11:55 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:11:55 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:11:56 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:11:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-a70826dd-4e62-42bc-9475-ecb05bcab8ca req-db5bcc0d-654b-4a4c-acf7-545beaf69821 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received event network-vif-deleted-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:56 user nova-compute[72815]: INFO nova.compute.manager [req-a70826dd-4e62-42bc-9475-ecb05bcab8ca req-db5bcc0d-654b-4a4c-acf7-545beaf69821 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Neutron deleted interface 8eef4553-caa7-4c0f-93f3-bef2adb15e66; detaching it from the instance and deleting it from the info cache
Aug 17 20:11:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-a70826dd-4e62-42bc-9475-ecb05bcab8ca req-db5bcc0d-654b-4a4c-acf7-545beaf69821 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:11:56 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Took 0.85 seconds to deallocate network for instance.
Aug 17 20:11:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-a70826dd-4e62-42bc-9475-ecb05bcab8ca req-db5bcc0d-654b-4a4c-acf7-545beaf69821 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Detach interface failed, port_id=8eef4553-caa7-4c0f-93f3-bef2adb15e66, reason: Instance 4c630764-4e1b-4bab-b354-1389cd60f5a5 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:11:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-a6065768-916b-4489-a9c2-0b3efb6684e5 req-784e22e2-519b-4c56-990c-9d1e63357157 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received event network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a6065768-916b-4489-a9c2-0b3efb6684e5 req-784e22e2-519b-4c56-990c-9d1e63357157 service nova] Acquiring lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a6065768-916b-4489-a9c2-0b3efb6684e5 req-784e22e2-519b-4c56-990c-9d1e63357157 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a6065768-916b-4489-a9c2-0b3efb6684e5 req-784e22e2-519b-4c56-990c-9d1e63357157 service nova] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-a6065768-916b-4489-a9c2-0b3efb6684e5 req-784e22e2-519b-4c56-990c-9d1e63357157 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] No waiting events found dispatching network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:11:56 user nova-compute[72815]: WARNING nova.compute.manager [req-a6065768-916b-4489-a9c2-0b3efb6684e5 req-784e22e2-519b-4c56-990c-9d1e63357157 service nova] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Received unexpected event network-vif-plugged-8eef4553-caa7-4c0f-93f3-bef2adb15e66 for instance with vm_state active and task_state deleting.
Aug 17 20:11:56 user nova-compute[72815]: INFO nova.compute.manager [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Took 0.80 seconds to detach 1 volumes for instance.
Aug 17 20:11:56 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Deleting volume: 228e179c-97dd-4ee6-978b-4450933aa2c9 {{(pid=72815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 20:11:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:57 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:11:57 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:11:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:57 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Deleted allocations for instance 4c630764-4e1b-4bab-b354-1389cd60f5a5
Aug 17 20:11:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1e1f2cb6-44f5-42d9-bd8d-427bdf34267c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "4c630764-4e1b-4bab-b354-1389cd60f5a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.461s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:58 user nova-compute[72815]: INFO nova.compute.manager [None req-93b400dd-dcdc-4493-9ace-eb6dd3d8ad55 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Unrescuing
Aug 17 20:11:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-93b400dd-dcdc-4493-9ace-eb6dd3d8ad55 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:11:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-93b400dd-dcdc-4493-9ace-eb6dd3d8ad55 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquired lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:11:58 user nova-compute[72815]: DEBUG nova.network.neutron [None req-93b400dd-dcdc-4493-9ace-eb6dd3d8ad55 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:11:59 user nova-compute[72815]: DEBUG nova.network.neutron [None req-93b400dd-dcdc-4493-9ace-eb6dd3d8ad55 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updating instance_info_cache with network_info: [{"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:11:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-93b400dd-dcdc-4493-9ace-eb6dd3d8ad55 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Releasing lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:11:59 user nova-compute[72815]: DEBUG nova.objects.instance [None req-93b400dd-dcdc-4493-9ace-eb6dd3d8ad55 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'flavor' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:11:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:59 user nova-compute[72815]: DEBUG nova.compute.manager [req-2df564e5-6ec8-4167-a4c5-abb8c92b06e9 req-602be8a1-08e4-4ec8-9624-574fb6f03594 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-unplugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:11:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2df564e5-6ec8-4167-a4c5-abb8c92b06e9 req-602be8a1-08e4-4ec8-9624-574fb6f03594 service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:11:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2df564e5-6ec8-4167-a4c5-abb8c92b06e9 req-602be8a1-08e4-4ec8-9624-574fb6f03594 service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:11:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2df564e5-6ec8-4167-a4c5-abb8c92b06e9 req-602be8a1-08e4-4ec8-9624-574fb6f03594 service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:11:59 user nova-compute[72815]: DEBUG nova.compute.manager [req-2df564e5-6ec8-4167-a4c5-abb8c92b06e9 req-602be8a1-08e4-4ec8-9624-574fb6f03594 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-unplugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:11:59 user nova-compute[72815]: WARNING nova.compute.manager [req-2df564e5-6ec8-4167-a4c5-abb8c92b06e9 req-602be8a1-08e4-4ec8-9624-574fb6f03594 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-unplugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state rescued and task_state unrescuing.
Aug 17 20:11:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:11:59 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Instance destroyed successfully.
Aug 17 20:11:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-0b788dec-8233-4b5b-be2d-873188368ecf req-e80cc60d-1343-45ec-918e-b5defba1de1c service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0b788dec-8233-4b5b-be2d-873188368ecf req-e80cc60d-1343-45ec-918e-b5defba1de1c service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0b788dec-8233-4b5b-be2d-873188368ecf req-e80cc60d-1343-45ec-918e-b5defba1de1c service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0b788dec-8233-4b5b-be2d-873188368ecf req-e80cc60d-1343-45ec-918e-b5defba1de1c service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-0b788dec-8233-4b5b-be2d-873188368ecf req-e80cc60d-1343-45ec-918e-b5defba1de1c service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:12:01 user nova-compute[72815]: WARNING nova.compute.manager [req-0b788dec-8233-4b5b-be2d-873188368ecf req-e80cc60d-1343-45ec-918e-b5defba1de1c service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state rescued and task_state unrescuing.
Aug 17 20:12:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-0b788dec-8233-4b5b-be2d-873188368ecf req-e80cc60d-1343-45ec-918e-b5defba1de1c service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0b788dec-8233-4b5b-be2d-873188368ecf req-e80cc60d-1343-45ec-918e-b5defba1de1c service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0b788dec-8233-4b5b-be2d-873188368ecf req-e80cc60d-1343-45ec-918e-b5defba1de1c service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0b788dec-8233-4b5b-be2d-873188368ecf req-e80cc60d-1343-45ec-918e-b5defba1de1c service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-0b788dec-8233-4b5b-be2d-873188368ecf req-e80cc60d-1343-45ec-918e-b5defba1de1c service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:12:01 user nova-compute[72815]: WARNING nova.compute.manager [req-0b788dec-8233-4b5b-be2d-873188368ecf req-e80cc60d-1343-45ec-918e-b5defba1de1c service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state rescued and task_state unrescuing.
Aug 17 20:12:01 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303106.6104848, 2ed62592-a25a-46cf-976a-5f2edbe6d5e0 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:12:01 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] VM Stopped (Lifecycle Event)
Aug 17 20:12:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f8160154-cf93-46a7-81e1-26e9872a36b9 None None] [instance: 2ed62592-a25a-46cf-976a-5f2edbe6d5e0] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:12:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:03 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for e7e09061-f65f-444b-98f6-409da28295e2 due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 20:12:03 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303123.2512991, e7e09061-f65f-444b-98f6-409da28295e2 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:12:03 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] VM Resumed (Lifecycle Event)
Aug 17 20:12:03 user nova-compute[72815]: DEBUG nova.compute.manager [None req-93b400dd-dcdc-4493-9ace-eb6dd3d8ad55 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:12:03 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:12:03 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:12:03 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 20:12:03 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303123.2548077, e7e09061-f65f-444b-98f6-409da28295e2 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:12:03 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] VM Started (Lifecycle Event)
Aug 17 20:12:03 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:12:03 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:12:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-6b87d6c9-b935-46ed-971a-30a486fd1534 req-3163882f-b286-4474-8b8f-42b949d64a1f service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6b87d6c9-b935-46ed-971a-30a486fd1534 req-3163882f-b286-4474-8b8f-42b949d64a1f service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6b87d6c9-b935-46ed-971a-30a486fd1534 req-3163882f-b286-4474-8b8f-42b949d64a1f service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6b87d6c9-b935-46ed-971a-30a486fd1534 req-3163882f-b286-4474-8b8f-42b949d64a1f service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-6b87d6c9-b935-46ed-971a-30a486fd1534 req-3163882f-b286-4474-8b8f-42b949d64a1f service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:12:03 user nova-compute[72815]: WARNING nova.compute.manager [req-6b87d6c9-b935-46ed-971a-30a486fd1534 req-3163882f-b286-4474-8b8f-42b949d64a1f service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state active and task_state None.
Aug 17 20:12:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-cacd7ba5-2906-46ff-9155-472676670f40 req-233a06f1-295d-418f-a3a3-c7a369d87cd6 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Received event network-changed-9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-cacd7ba5-2906-46ff-9155-472676670f40 req-233a06f1-295d-418f-a3a3-c7a369d87cd6 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Refreshing instance network info cache due to event network-changed-9955b382-2169-4d4e-a593-a85808d52584. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:12:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cacd7ba5-2906-46ff-9155-472676670f40 req-233a06f1-295d-418f-a3a3-c7a369d87cd6 service nova] Acquiring lock "refresh_cache-b4462060-b172-4a3b-b9ed-d6b8514c8d97" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:12:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cacd7ba5-2906-46ff-9155-472676670f40 req-233a06f1-295d-418f-a3a3-c7a369d87cd6 service nova] Acquired lock "refresh_cache-b4462060-b172-4a3b-b9ed-d6b8514c8d97" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:12:05 user nova-compute[72815]: DEBUG nova.network.neutron [req-cacd7ba5-2906-46ff-9155-472676670f40 req-233a06f1-295d-418f-a3a3-c7a369d87cd6 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Refreshing network info cache for port 9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:12:06 user nova-compute[72815]: DEBUG nova.network.neutron [req-cacd7ba5-2906-46ff-9155-472676670f40 req-233a06f1-295d-418f-a3a3-c7a369d87cd6 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Updated VIF entry in instance network info cache for port 9955b382-2169-4d4e-a593-a85808d52584. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:12:06 user nova-compute[72815]: DEBUG nova.network.neutron [req-cacd7ba5-2906-46ff-9155-472676670f40 req-233a06f1-295d-418f-a3a3-c7a369d87cd6 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Updating instance_info_cache with network_info: [{"id": "9955b382-2169-4d4e-a593-a85808d52584", "address": "fa:16:3e:4d:1b:d5", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9955b382-21", "ovs_interfaceid": "9955b382-2169-4d4e-a593-a85808d52584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:12:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cacd7ba5-2906-46ff-9155-472676670f40 req-233a06f1-295d-418f-a3a3-c7a369d87cd6 service nova] Releasing lock "refresh_cache-b4462060-b172-4a3b-b9ed-d6b8514c8d97" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:12:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:09 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303114.8433566, 4c630764-4e1b-4bab-b354-1389cd60f5a5 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:12:09 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] VM Stopped (Lifecycle Event)
Aug 17 20:12:09 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d7bf1d7a-f2ae-4a84-88f9-222813270adf None None] [instance: 4c630764-4e1b-4bab-b354-1389cd60f5a5] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:12:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:10 user nova-compute[72815]: DEBUG nova.objects.instance [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'flavor' on Instance uuid b4462060-b172-4a3b-b9ed-d6b8514c8d97 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:12:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:11 user nova-compute[72815]: INFO nova.compute.manager [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Attaching volume 1214529b-646a-4829-9b1c-a94b11096191 to /dev/vdb
Aug 17 20:12:11 user nova-compute[72815]: DEBUG os_brick.utils [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa13838b-6e1f-45d8-9013-2a86dda07471]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1874ff7-b980-4604-a062-8f49b3fee0d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[156b7adc-92ac-4caa-adba-8b499163d2ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdb72cb-2ce7-4f49-8f29-67437821c7fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:12:11 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:12:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0bc34c-2ed4-4d47-ac6d-dfd76ab7703a]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG os_brick.utils [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:12:11 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Updating existing volume attachment record: aa221e93-82ec-4f77-91b6-e89e8821add6 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:12:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:19 user nova-compute[72815]: INFO nova.compute.manager [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Terminating instance
Aug 17 20:12:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:12:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-fe651441-7c70-4063-974a-5691008aef54 req-d6a9fd11-4e37-43db-b147-b4666e31e2f4 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-unplugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fe651441-7c70-4063-974a-5691008aef54 req-d6a9fd11-4e37-43db-b147-b4666e31e2f4 service nova] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fe651441-7c70-4063-974a-5691008aef54 req-d6a9fd11-4e37-43db-b147-b4666e31e2f4 service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-fe651441-7c70-4063-974a-5691008aef54 req-d6a9fd11-4e37-43db-b147-b4666e31e2f4 service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-fe651441-7c70-4063-974a-5691008aef54 req-d6a9fd11-4e37-43db-b147-b4666e31e2f4 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] No waiting events found dispatching network-vif-unplugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-fe651441-7c70-4063-974a-5691008aef54 req-d6a9fd11-4e37-43db-b147-b4666e31e2f4 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-unplugged-682cf83c-ed24-401a-bdd4-7375f529aacb for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:12:20 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Instance destroyed successfully.
Aug 17 20:12:20 user nova-compute[72815]: DEBUG nova.objects.instance [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'resources' on Instance uuid ac6faff5-9700-4504-81d8-8ba2ab64d85f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:56:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-686218442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-686218442',id=13,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:58:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-h68ujh5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:00:18Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=ac6faff5-9700-4504-81d8-8ba2ab64d85f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "682cf83c-ed24-401a-bdd4-7375f529aacb", "address": "fa:16:3e:0d:ba:21", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682cf83c-ed", "ovs_interfaceid": "682cf83c-ed24-401a-bdd4-7375f529aacb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ba:21,bridge_name='br-int',has_traffic_filtering=True,id=682cf83c-ed24-401a-bdd4-7375f529aacb,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682cf83c-ed') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_vif [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ba:21,bridge_name='br-int',has_traffic_filtering=True,id=682cf83c-ed24-401a-bdd4-7375f529aacb,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682cf83c-ed') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap682cf83c-ed, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:12:20 user nova-compute[72815]: INFO os_vif [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ba:21,bridge_name='br-int',has_traffic_filtering=True,id=682cf83c-ed24-401a-bdd4-7375f529aacb,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682cf83c-ed')
Aug 17 20:12:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVceLKTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:12:20 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[77513572-6d20-47b3-b9b3-f0b37d594080]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c063a5cd-84bd-4037-80bd-e41ab76b70d8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:12:20 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:20 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:20 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:20 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e (non-flash)
Aug 17 20:12:20 user nova-compute[72815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:20 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:20 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:20 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399434bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e'): ({'sdc'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Removing single pathed devices sdc {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6c7bba-1ee6-4e58-b9e4-7784d283afc3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[25db8998-c2a7-48f1-aba7-3085eaa63551]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Flushing IO for device /dev/sdc {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca4abee-e7af-417e-949b-c5c6fa02587d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0927d7-e447-43a3-bfb3-3579bd9b34ca]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[987b9eea-93d0-4acd-a41e-1a4c6b2a29a3]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[546fbd99-f6bb-4a63-9dd9-4a171cb44443]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e, portal: 172.16.0.220,3260]
Aug 17 20:12:20 user nova-compute[72815]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e, portal: 172.16.0.220,3260] successful.
Aug 17 20:12:20 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae0b87c-745e-44d1-b1d5-b8d76b9b6b6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[de918ce9-a9f1-4160-8beb-c2e1c59782f8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] <== disconnect_volume: return (372ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:12:20 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Deleting instance files /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f_del
Aug 17 20:12:20 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Deletion of /opt/stack/data/nova/instances/ac6faff5-9700-4504-81d8-8ba2ab64d85f_del complete
Aug 17 20:12:20 user nova-compute[72815]: INFO nova.compute.manager [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 17 20:12:20 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:12:20 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:12:21 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:12:21 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Took 0.47 seconds to deallocate network for instance.
Aug 17 20:12:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-ade448bc-8901-4f78-99e4-526030952fd0 req-8e986c37-5ae4-4c28-8d44-9ec12cc09555 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-deleted-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-1812a064-bf5b-4209-b5ed-7d7638d07bc9 req-540edeae-a4b9-469a-b274-379a8982e2a2 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1812a064-bf5b-4209-b5ed-7d7638d07bc9 req-540edeae-a4b9-469a-b274-379a8982e2a2 service nova] Acquiring lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1812a064-bf5b-4209-b5ed-7d7638d07bc9 req-540edeae-a4b9-469a-b274-379a8982e2a2 service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1812a064-bf5b-4209-b5ed-7d7638d07bc9 req-540edeae-a4b9-469a-b274-379a8982e2a2 service nova] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-1812a064-bf5b-4209-b5ed-7d7638d07bc9 req-540edeae-a4b9-469a-b274-379a8982e2a2 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] No waiting events found dispatching network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:12:22 user nova-compute[72815]: WARNING nova.compute.manager [req-1812a064-bf5b-4209-b5ed-7d7638d07bc9 req-540edeae-a4b9-469a-b274-379a8982e2a2 service nova] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Received unexpected event network-vif-plugged-682cf83c-ed24-401a-bdd4-7375f529aacb for instance with vm_state active and task_state deleting.
Aug 17 20:12:22 user nova-compute[72815]: INFO nova.compute.manager [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Took 0.81 seconds to detach 1 volumes for instance.
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyiOoUfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:12:22 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:12:22 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:12:22 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:22 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Deleted allocations for instance ac6faff5-9700-4504-81d8-8ba2ab64d85f
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4babd2f-ba6c-47d0-8fd9-f1cb5363599e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:12:22 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[91abcbcc-0cdf-4e2a-85a6-9b8064936db3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191] added
Aug 17 20:12:22 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[765d9d62-d4be-4bc5-a255-fcea332f4989]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d956eaff-7e62-4240-8ff9-ceca2a03aaa6 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "ac6faff5-9700-4504-81d8-8ba2ab64d85f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.211s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4a0fd8-d363-4d60-a93a-712f21508d9a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lyiOoUfS {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lyiOoUfS" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a1d0c0-ac0e-49ac-aba4-27c44f9f11bd]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lyiOoUfS'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56f1df7-67b2-4a34-9e63-8c9f79989367]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb064ec-5756-4835-96f2-4686744ceeb2]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:22 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:22 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:22 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:22 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:22 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:22 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:12:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e2f3fc-7080-4de6-9122-cbe549ceb8e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191, portal: 172.16.0.220,3260]
Aug 17 20:12:23 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191, portal: 172.16.0.220,3260] successful.
Aug 17 20:12:23 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a67573-7502-415b-8112-2781c32e92e1]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b754a630-35b3-47bc-9b6c-87d422d9d0d0]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:23 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:23 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:23 user nova-compute[72815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 (non-flash)
Aug 17 20:12:23 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:23 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:23 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:23 user nova-compute[72815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 (non-flash)
Aug 17 20:12:23 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1a2dc8-0609-4e62-b2ee-d33593708c6b]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:12:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyiOoUfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:12:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:12:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26132393562646165', 'path': '/dev/sdc'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:12:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132393562646165', 'path': '/dev/sdc'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:12:24 user nova-compute[72815]: DEBUG nova.objects.instance [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'flavor' on Instance uuid b4462060-b172-4a3b-b9ed-d6b8514c8d97 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:12:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:12:24 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:12:24 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 20:12:24 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:12:24 user nova-compute[72815]:   <serial>1214529b-646a-4829-9b1c-a94b11096191</serial>
Aug 17 20:12:24 user nova-compute[72815]: </disk>
Aug 17 20:12:24 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:12:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:12:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:12:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No VIF found with MAC fa:16:3e:4d:1b:d5, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:12:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4b474990-152e-41a1-88fc-56bb0e7cf6b4 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.670s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:25 user nova-compute[72815]: INFO nova.compute.manager [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Detaching volume 1214529b-646a-4829-9b1c-a94b11096191
Aug 17 20:12:25 user nova-compute[72815]: INFO nova.virt.block_device [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Attempting to driver detach volume 1214529b-646a-4829-9b1c-a94b11096191 from mountpoint /dev/vdb
Aug 17 20:12:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Attempting to detach device vdb from instance b4462060-b172-4a3b-b9ed-d6b8514c8d97 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:12:25 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:12:25 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 20:12:25 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:12:25 user nova-compute[72815]:   <serial>1214529b-646a-4829-9b1c-a94b11096191</serial>
Aug 17 20:12:25 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:12:25 user nova-compute[72815]: </disk>
Aug 17 20:12:25 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:12:25 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully detached device vdb from instance b4462060-b172-4a3b-b9ed-d6b8514c8d97 from the persistent domain config.
Aug 17 20:12:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b4462060-b172-4a3b-b9ed-d6b8514c8d97 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:12:25 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:12:25 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 20:12:25 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:12:25 user nova-compute[72815]:   <serial>1214529b-646a-4829-9b1c-a94b11096191</serial>
Aug 17 20:12:25 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:12:25 user nova-compute[72815]: </disk>
Aug 17 20:12:25 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692303145.8447156, b4462060-b172-4a3b-b9ed-d6b8514c8d97 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b4462060-b172-4a3b-b9ed-d6b8514c8d97 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:12:25 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully detached device vdb from instance b4462060-b172-4a3b-b9ed-d6b8514c8d97 from the live domain config.
Aug 17 20:12:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyiOoUfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:12:25 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:12:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9318c0-7f9e-4403-b3b1-9bf28bbf8f43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c2a177-09f4-477b-97b6-27cbd2f0a608]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:25 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:25 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:25 user nova-compute[72815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 (non-flash)
Aug 17 20:12:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:25 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:25 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:25 user nova-compute[72815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 (non-flash)
Aug 17 20:12:25 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399449cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191'): ({'sdc'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Removing single pathed devices sdc {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8e857f-5555-4e2b-b9c5-9ada4f895c6d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbfa771-a511-4cd2-ad59-99062c0059e6]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Flushing IO for device /dev/sdc {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75c26a8-ad18-4894-af6a-c04b6dd846c8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:12:25 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00028a3-7138-46c9-ad6a-32f361ae42c8]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[464a44cb-d8ce-4df2-9d45-d1fceb5f3a17]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f5c92c-9356-4a27-90bc-2d7b4493843e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191, portal: 172.16.0.220,3260]
Aug 17 20:12:26 user nova-compute[72815]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191, portal: 172.16.0.220,3260] successful.
Aug 17 20:12:26 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1214529b-646a-4829-9b1c-a94b11096191 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bfab94-0944-42cf-832f-f73db9e1038f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] <== disconnect_volume: return (273ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG nova.objects.instance [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'flavor' on Instance uuid b4462060-b172-4a3b-b9ed-d6b8514c8d97 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:12:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d9ba21f5-8459-4811-a8ca-b4f3e9447940 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.647s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:33 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'flavor' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:12:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:33 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:12:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:33 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:12:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:33 user nova-compute[72815]: INFO nova.compute.manager [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Attaching volume 72729c38-23de-4f06-b29b-a5e83e194380 to /dev/vdb
Aug 17 20:12:34 user nova-compute[72815]: DEBUG os_brick.utils [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f468e1-b728-4403-8a3e-35ffa0bf246d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[010febc5-28e4-4687-8969-6e61aa3aa9a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa17cdb-4fc1-4429-83ca-effb290aab87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e1cbda-5e06-4466-9bf0-db6a327eec89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:12:34 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9327faf6-994f-4f84-909b-06f04a74c4de]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG os_brick.utils [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updating existing volume attachment record: 1265e25c-f0af-4b14-97f1-5284a554c0d1 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303140.4937627, ac6faff5-9700-4504-81d8-8ba2ab64d85f => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:12:35 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] VM Stopped (Lifecycle Event)
Aug 17 20:12:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG nova.compute.manager [None req-936b618a-5c74-4e83-9e98-3e7361fefaab None None] [instance: ac6faff5-9700-4504-81d8-8ba2ab64d85f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:35 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:12:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:12:38 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:12:38 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7137MB free_disk=25.211353302001953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 1a714bfa-0b06-4ef8-865a-819abbc64be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ab784398-43df-4214-bdd3-22c652ac710f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 8ac64ac9-a49d-4c70-956b-3a140da5ede8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 99693a7e-71e3-4543-b649-41a147c77c7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance e7e09061-f65f-444b-98f6-409da28295e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 62614d4a-13bb-4c75-8f84-c47bdbf7b024 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance b4462060-b172-4a3b-b9ed-d6b8514c8d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 167eb80d-4ac2-4b82-b3ab-897ac91247f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:12:38 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:12:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:12:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Updating instance_info_cache with network_info: [{"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-ec0afde2-8d2b-451a-a226-be933e28ad6f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:12:41 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:12:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:12:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:12:44 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUxkVEly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:12:45 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:12:45 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:12:45 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[357477e5-18d1-4cce-99a9-bd63a82ba5a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:12:45 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[496fbdeb-3d47-4f00-ab50-a757ab6ef972]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380] added
Aug 17 20:12:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f65e65-3650-4516-b7de-0eac0b51542d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe42683-5ee7-4dd8-a790-3e5876fe8ceb]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUxkVEly {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUxkVEly" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9b650d-01d4-431d-b62f-bd74acbd5ea8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mUxkVEly'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[da23d744-9902-4119-85af-493cd3ef9797]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbc9744-919c-4c11-b6ce-0b1f518a36ca]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:45 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:45 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:45 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:45 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b92af9-e061-4911-9eab-abd2b6331a39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380, portal: 172.16.0.220,3260]
Aug 17 20:12:45 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380, portal: 172.16.0.220,3260] successful.
Aug 17 20:12:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccd964f-29d4-4ba3-aed1-56a7e50e1310]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb65f41-6ef0-4b3d-a0aa-da00334367c5]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:45 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:45 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:45 user nova-compute[72815]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 (non-flash)
Aug 17 20:12:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:45 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:45 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:45 user nova-compute[72815]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 (non-flash)
Aug 17 20:12:45 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc64f471-913d-48f0-8e20-5276d6fd169f]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:45 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:12:46 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:12:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUxkVEly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:12:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:12:46 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23665333135616535', 'path': '/dev/sdc'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:12:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665333135616535', 'path': '/dev/sdc'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:12:46 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'flavor' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:12:46 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:12:46 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:12:46 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 20:12:46 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:12:46 user nova-compute[72815]:   <serial>72729c38-23de-4f06-b29b-a5e83e194380</serial>
Aug 17 20:12:46 user nova-compute[72815]: </disk>
Aug 17 20:12:46 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:12:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:12:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:12:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] No VIF found with MAC fa:16:3e:29:77:f9, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:12:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0494bff0-d7d8-48c0-acef-1c1cd30abc9e tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.287s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:49 user nova-compute[72815]: INFO nova.compute.manager [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Detaching volume 72729c38-23de-4f06-b29b-a5e83e194380
Aug 17 20:12:49 user nova-compute[72815]: INFO nova.virt.block_device [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Attempting to driver detach volume 72729c38-23de-4f06-b29b-a5e83e194380 from mountpoint /dev/vdb
Aug 17 20:12:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Attempting to detach device vdb from instance 99693a7e-71e3-4543-b649-41a147c77c7e from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:12:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:12:49 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:12:49 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 20:12:49 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:12:49 user nova-compute[72815]:   <serial>72729c38-23de-4f06-b29b-a5e83e194380</serial>
Aug 17 20:12:49 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:12:49 user nova-compute[72815]: </disk>
Aug 17 20:12:49 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:12:49 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Successfully detached device vdb from instance 99693a7e-71e3-4543-b649-41a147c77c7e from the persistent domain config.
Aug 17 20:12:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99693a7e-71e3-4543-b649-41a147c77c7e from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:12:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:12:49 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:12:49 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 20:12:49 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:12:49 user nova-compute[72815]:   <serial>72729c38-23de-4f06-b29b-a5e83e194380</serial>
Aug 17 20:12:49 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:12:49 user nova-compute[72815]: </disk>
Aug 17 20:12:49 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692303170.1413558, 99693a7e-71e3-4543-b649-41a147c77c7e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:12:50 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Successfully detached device vdb from instance 99693a7e-71e3-4543-b649-41a147c77c7e from the live domain config.
Aug 17 20:12:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUxkVEly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:12:50 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1308b83-7bdd-48a7-a54b-25458803912a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ade0ab-32d1-43e7-a194-63bb8316838e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:50 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:50 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:50 user nova-compute[72815]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 (non-flash)
Aug 17 20:12:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:50 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:50 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:50 user nova-compute[72815]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 (non-flash)
Aug 17 20:12:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b4309240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380'): ({'sdc'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Removing single pathed devices sdc {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef02cdc3-c066-4359-905d-c83143817115]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[52027f74-bebe-45cf-8aae-e14a2a06ba9d]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Flushing IO for device /dev/sdc {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2847742-6d6c-4704-8715-3ea7f7f537fa]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb01a72-faca-49a4-812e-482c228696fb]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[638e9fd1-e535-4efc-8993-899d2ea1bf35]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-7e737ec5-6ffa-4dab-8420-a85c6b6130d9 req-3b308117-f167-4284-89a1-62e09a71cecb service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Received event network-changed-d5b95762-5800-49c5-9cf1-f8582b17c337 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-7e737ec5-6ffa-4dab-8420-a85c6b6130d9 req-3b308117-f167-4284-89a1-62e09a71cecb service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Refreshing instance network info cache due to event network-changed-d5b95762-5800-49c5-9cf1-f8582b17c337. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7e737ec5-6ffa-4dab-8420-a85c6b6130d9 req-3b308117-f167-4284-89a1-62e09a71cecb service nova] Acquiring lock "refresh_cache-4d1f0f1d-f55f-4aa3-b642-512ff95b5955" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7e737ec5-6ffa-4dab-8420-a85c6b6130d9 req-3b308117-f167-4284-89a1-62e09a71cecb service nova] Acquired lock "refresh_cache-4d1f0f1d-f55f-4aa3-b642-512ff95b5955" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-7e737ec5-6ffa-4dab-8420-a85c6b6130d9 req-3b308117-f167-4284-89a1-62e09a71cecb service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Refreshing network info cache for port d5b95762-5800-49c5-9cf1-f8582b17c337 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a6c05d-2d33-4e46-939a-35389c8160f1]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380, portal: 172.16.0.220,3260]
Aug 17 20:12:50 user nova-compute[72815]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380, portal: 172.16.0.220,3260] successful.
Aug 17 20:12:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72729c38-23de-4f06-b29b-a5e83e194380 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f950f37d-11a5-43de-891f-c16f1af75e4a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] <== disconnect_volume: return (301ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG nova.objects.instance [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lazy-loading 'flavor' on Instance uuid 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:12:50 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Ignoring supplied device name: /dev/vdb
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-7e737ec5-6ffa-4dab-8420-a85c6b6130d9 req-3b308117-f167-4284-89a1-62e09a71cecb service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Updated VIF entry in instance network info cache for port d5b95762-5800-49c5-9cf1-f8582b17c337. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-7e737ec5-6ffa-4dab-8420-a85c6b6130d9 req-3b308117-f167-4284-89a1-62e09a71cecb service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Updating instance_info_cache with network_info: [{"id": "d5b95762-5800-49c5-9cf1-f8582b17c337", "address": "fa:16:3e:70:5f:c6", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b95762-58", "ovs_interfaceid": "d5b95762-5800-49c5-9cf1-f8582b17c337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7e737ec5-6ffa-4dab-8420-a85c6b6130d9 req-3b308117-f167-4284-89a1-62e09a71cecb service nova] Releasing lock "refresh_cache-4d1f0f1d-f55f-4aa3-b642-512ff95b5955" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:50 user nova-compute[72815]: INFO nova.compute.manager [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Attaching volume 2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b to /dev/vdb
Aug 17 20:12:51 user nova-compute[72815]: DEBUG os_brick.utils [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b651559a-6991-4917-9de9-7cd6c92b0d84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b024cbb1-6c29-4b73-961f-7b2b3705bcd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d52d1c7-7424-4ed6-aadf-b3b20932ef3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb9409b-0b2f-43e6-8489-7171ec46cec3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:12:51 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d01636-1652-4b85-99d0-c5ce23f75024]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG os_brick.utils [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Updating existing volume attachment record: 05c37d68-9263-4c1f-a0b8-8582020b73f8 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG nova.objects.instance [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'flavor' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:12:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-4652b2ab-c0a8-4bd4-983c-525b9309a7c5 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.675s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "ab784398-43df-4214-bdd3-22c652ac710f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "ab784398-43df-4214-bdd3-22c652ac710f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "ab784398-43df-4214-bdd3-22c652ac710f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "ab784398-43df-4214-bdd3-22c652ac710f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "ab784398-43df-4214-bdd3-22c652ac710f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:52 user nova-compute[72815]: INFO nova.compute.manager [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Terminating instance
Aug 17 20:12:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-a69a15c5-d8f8-4b3b-b73b-d9968eb48529 req-c53f0ef1-af01-4cec-a95d-416481140c21 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Received event network-vif-unplugged-d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a69a15c5-d8f8-4b3b-b73b-d9968eb48529 req-c53f0ef1-af01-4cec-a95d-416481140c21 service nova] Acquiring lock "ab784398-43df-4214-bdd3-22c652ac710f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a69a15c5-d8f8-4b3b-b73b-d9968eb48529 req-c53f0ef1-af01-4cec-a95d-416481140c21 service nova] Lock "ab784398-43df-4214-bdd3-22c652ac710f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a69a15c5-d8f8-4b3b-b73b-d9968eb48529 req-c53f0ef1-af01-4cec-a95d-416481140c21 service nova] Lock "ab784398-43df-4214-bdd3-22c652ac710f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-a69a15c5-d8f8-4b3b-b73b-d9968eb48529 req-c53f0ef1-af01-4cec-a95d-416481140c21 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] No waiting events found dispatching network-vif-unplugged-d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-a69a15c5-d8f8-4b3b-b73b-d9968eb48529 req-c53f0ef1-af01-4cec-a95d-416481140c21 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Received event network-vif-unplugged-d049d487-388c-408b-ada5-ae68e86585c3 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:12:52 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Instance destroyed successfully.
Aug 17 20:12:52 user nova-compute[72815]: DEBUG nova.objects.instance [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lazy-loading 'resources' on Instance uuid ab784398-43df-4214-bdd3-22c652ac710f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1794052344',display_name='tempest-ServerActionsTestOtherA-server-1794052344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1794052344',id=3,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4ENuaMW9sQVv3tRQvGXO2rdSecjVcsBbTS05/ZUuaQNEEpkOe2HF0EHrSzQ0+4hhL3IgPXmkF5ZxUJ6bIwwpVvvT5kiu8Xp5gaO6UacRTK/fZorahpTHXq4z54fcfMBQ==',key_name='tempest-keypair-1973140313',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:53:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0708d4f49ed4c96b108d1d2aff76871',ramdisk_id='',reservation_id='r-iv78cz1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-629489909',owner_user_name='tempest-ServerActionsTestOtherA-629489909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9821282c73174c448f7fca6b65676f61',uuid=ab784398-43df-4214-bdd3-22c652ac710f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converting VIF {"id": "d049d487-388c-408b-ada5-ae68e86585c3", "address": "fa:16:3e:a0:5f:47", "network": {"id": "c0967a65-56c0-4d0a-996c-a200af581f38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1515676333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0708d4f49ed4c96b108d1d2aff76871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd049d487-38", "ovs_interfaceid": "d049d487-388c-408b-ada5-ae68e86585c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:5f:47,bridge_name='br-int',has_traffic_filtering=True,id=d049d487-388c-408b-ada5-ae68e86585c3,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd049d487-38') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG os_vif [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:5f:47,bridge_name='br-int',has_traffic_filtering=True,id=d049d487-388c-408b-ada5-ae68e86585c3,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd049d487-38') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd049d487-38, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:12:52 user nova-compute[72815]: INFO os_vif [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:5f:47,bridge_name='br-int',has_traffic_filtering=True,id=d049d487-388c-408b-ada5-ae68e86585c3,network=Network(c0967a65-56c0-4d0a-996c-a200af581f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd049d487-38')
Aug 17 20:12:52 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Deleting instance files /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f_del
Aug 17 20:12:52 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Deletion of /opt/stack/data/nova/instances/ab784398-43df-4214-bdd3-22c652ac710f_del complete
Aug 17 20:12:53 user nova-compute[72815]: INFO nova.compute.manager [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 20:12:53 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:12:53 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:12:53 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: ab784398-43df-4214-bdd3-22c652ac710f] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:12:53 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:12:53 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Took 0.49 seconds to deallocate network for instance.
Aug 17 20:12:53 user nova-compute[72815]: DEBUG nova.compute.manager [req-2c1bbf75-67c0-460d-85db-3c6ace262359 req-70d3e52e-4b92-4610-894c-2908e3f183b2 service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Received event network-vif-deleted-d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:53 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:12:53 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:12:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:53 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Deleted allocations for instance ab784398-43df-4214-bdd3-22c652ac710f
Aug 17 20:12:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-20b7783e-a0b1-47ce-bf59-195c36bf633c tempest-ServerActionsTestOtherA-629489909 tempest-ServerActionsTestOtherA-629489909-project-member] Lock "ab784398-43df-4214-bdd3-22c652ac710f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.913s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-a8e3e040-7202-4d96-b582-8f7fd4d73d8e req-d7409782-8090-463d-ad5e-83f8590b276a service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Received event network-vif-plugged-d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a8e3e040-7202-4d96-b582-8f7fd4d73d8e req-d7409782-8090-463d-ad5e-83f8590b276a service nova] Acquiring lock "ab784398-43df-4214-bdd3-22c652ac710f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a8e3e040-7202-4d96-b582-8f7fd4d73d8e req-d7409782-8090-463d-ad5e-83f8590b276a service nova] Lock "ab784398-43df-4214-bdd3-22c652ac710f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a8e3e040-7202-4d96-b582-8f7fd4d73d8e req-d7409782-8090-463d-ad5e-83f8590b276a service nova] Lock "ab784398-43df-4214-bdd3-22c652ac710f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-a8e3e040-7202-4d96-b582-8f7fd4d73d8e req-d7409782-8090-463d-ad5e-83f8590b276a service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] No waiting events found dispatching network-vif-plugged-d049d487-388c-408b-ada5-ae68e86585c3 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:12:54 user nova-compute[72815]: WARNING nova.compute.manager [req-a8e3e040-7202-4d96-b582-8f7fd4d73d8e req-d7409782-8090-463d-ad5e-83f8590b276a service nova] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Received unexpected event network-vif-plugged-d049d487-388c-408b-ada5-ae68e86585c3 for instance with vm_state deleted and task_state None.
Aug 17 20:12:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-f9d0df16-ef84-4758-be6d-1ffb6d3f3306 req-86c4f2c3-ffca-4700-a28e-0767f370b292 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Received event network-changed-9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-f9d0df16-ef84-4758-be6d-1ffb6d3f3306 req-86c4f2c3-ffca-4700-a28e-0767f370b292 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Refreshing instance network info cache due to event network-changed-9e4528ff-8473-4b16-90f7-d204b176cee2. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:12:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f9d0df16-ef84-4758-be6d-1ffb6d3f3306 req-86c4f2c3-ffca-4700-a28e-0767f370b292 service nova] Acquiring lock "refresh_cache-167eb80d-4ac2-4b82-b3ab-897ac91247f2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:12:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f9d0df16-ef84-4758-be6d-1ffb6d3f3306 req-86c4f2c3-ffca-4700-a28e-0767f370b292 service nova] Acquired lock "refresh_cache-167eb80d-4ac2-4b82-b3ab-897ac91247f2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:12:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-f9d0df16-ef84-4758-be6d-1ffb6d3f3306 req-86c4f2c3-ffca-4700-a28e-0767f370b292 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Refreshing network info cache for port 9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-f9d0df16-ef84-4758-be6d-1ffb6d3f3306 req-86c4f2c3-ffca-4700-a28e-0767f370b292 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Updated VIF entry in instance network info cache for port 9e4528ff-8473-4b16-90f7-d204b176cee2. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-f9d0df16-ef84-4758-be6d-1ffb6d3f3306 req-86c4f2c3-ffca-4700-a28e-0767f370b292 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Updating instance_info_cache with network_info: [{"id": "9e4528ff-8473-4b16-90f7-d204b176cee2", "address": "fa:16:3e:dc:4d:0b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4528ff-84", "ovs_interfaceid": "9e4528ff-8473-4b16-90f7-d204b176cee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f9d0df16-ef84-4758-be6d-1ffb6d3f3306 req-86c4f2c3-ffca-4700-a28e-0767f370b292 service nova] Releasing lock "refresh_cache-167eb80d-4ac2-4b82-b3ab-897ac91247f2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:57 user nova-compute[72815]: INFO nova.compute.manager [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Terminating instance
Aug 17 20:12:57 user nova-compute[72815]: DEBUG nova.compute.manager [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:57 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Instance destroyed successfully.
Aug 17 20:12:57 user nova-compute[72815]: DEBUG nova.objects.instance [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lazy-loading 'resources' on Instance uuid 167eb80d-4ac2-4b82-b3ab-897ac91247f2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:11:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-928679878',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-928679878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-928679878',id=40,image_ref='9e340a8b-d58e-4e56-aed3-b90f530613c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlxamuUfxZN5MraL5JaxpuYbxc7bi6jV+uxxWVdzOAUnPkjYlCe0MXEJ2AkUtEZ/UYUBzTFo/P9JN+JCvUQrVWYQT1GLYxM/spmlesbypvBftcF4+sVsPE/2MFFQcY/0Q==',key_name='tempest-keypair-1197686493',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:11:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-uzo94qf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-781314261',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:11:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577ed0692a254a2fbd518e258563447f',uuid=167eb80d-4ac2-4b82-b3ab-897ac91247f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e4528ff-8473-4b16-90f7-d204b176cee2", "address": "fa:16:3e:dc:4d:0b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4528ff-84", "ovs_interfaceid": "9e4528ff-8473-4b16-90f7-d204b176cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "9e4528ff-8473-4b16-90f7-d204b176cee2", "address": "fa:16:3e:dc:4d:0b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4528ff-84", "ovs_interfaceid": "9e4528ff-8473-4b16-90f7-d204b176cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:0b,bridge_name='br-int',has_traffic_filtering=True,id=9e4528ff-8473-4b16-90f7-d204b176cee2,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4528ff-84') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG os_vif [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:0b,bridge_name='br-int',has_traffic_filtering=True,id=9e4528ff-8473-4b16-90f7-d204b176cee2,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4528ff-84') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e4528ff-84, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:12:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:12:58 user nova-compute[72815]: INFO os_vif [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:0b,bridge_name='br-int',has_traffic_filtering=True,id=9e4528ff-8473-4b16-90f7-d204b176cee2,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4528ff-84')
Aug 17 20:12:58 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVuNiLqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:12:58 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e74de2-6866-4051-9401-921ad49a670b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaf8ecf-4b8f-4ef5-b7c3-353d7fdbb817]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:58 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:58 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:58 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:12:58 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:12:58 user nova-compute[72815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d (non-flash)
Aug 17 20:12:58 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994743eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d'): ({'sdb'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Removing single pathed devices sdb {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cea0cf7-fd66-409f-b8b4-03cb2358f08a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b9ff1e-23d7-419d-9e5d-01c7e613d03f]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flushing IO for device /dev/sdb {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4930b45-10ff-49b6-8dc3-7ec7176fee57]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabc3ebd-6845-4322-b8cd-03c5c8c728dc]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e292c1-d44d-4a08-8949-a550e9bc4589]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3140db2c-c35e-4ded-a343-681b90a0dffa]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d, portal: 172.16.0.220,3260]
Aug 17 20:12:58 user nova-compute[72815]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d, portal: 172.16.0.220,3260] successful.
Aug 17 20:12:58 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da334dde-d96a-4550-9235-ca24be554e4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e00c647-fe5a-4ed9-9ded-1dd54e2ae7d0]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== disconnect_volume: return (338ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:12:58 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Deleting instance files /opt/stack/data/nova/instances/167eb80d-4ac2-4b82-b3ab-897ac91247f2_del
Aug 17 20:12:58 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Deletion of /opt/stack/data/nova/instances/167eb80d-4ac2-4b82-b3ab-897ac91247f2_del complete
Aug 17 20:12:58 user nova-compute[72815]: INFO nova.compute.manager [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-2d041bf0-b1da-42c3-8a0c-1eed074908d9 req-d40c1e30-c1b5-4ca5-82ca-35901f6a9c87 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Received event network-vif-unplugged-9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2d041bf0-b1da-42c3-8a0c-1eed074908d9 req-d40c1e30-c1b5-4ca5-82ca-35901f6a9c87 service nova] Acquiring lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2d041bf0-b1da-42c3-8a0c-1eed074908d9 req-d40c1e30-c1b5-4ca5-82ca-35901f6a9c87 service nova] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2d041bf0-b1da-42c3-8a0c-1eed074908d9 req-d40c1e30-c1b5-4ca5-82ca-35901f6a9c87 service nova] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-2d041bf0-b1da-42c3-8a0c-1eed074908d9 req-d40c1e30-c1b5-4ca5-82ca-35901f6a9c87 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] No waiting events found dispatching network-vif-unplugged-9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-2d041bf0-b1da-42c3-8a0c-1eed074908d9 req-d40c1e30-c1b5-4ca5-82ca-35901f6a9c87 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Received event network-vif-unplugged-9e4528ff-8473-4b16-90f7-d204b176cee2 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-2d041bf0-b1da-42c3-8a0c-1eed074908d9 req-d40c1e30-c1b5-4ca5-82ca-35901f6a9c87 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Received event network-vif-plugged-9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2d041bf0-b1da-42c3-8a0c-1eed074908d9 req-d40c1e30-c1b5-4ca5-82ca-35901f6a9c87 service nova] Acquiring lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2d041bf0-b1da-42c3-8a0c-1eed074908d9 req-d40c1e30-c1b5-4ca5-82ca-35901f6a9c87 service nova] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2d041bf0-b1da-42c3-8a0c-1eed074908d9 req-d40c1e30-c1b5-4ca5-82ca-35901f6a9c87 service nova] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:12:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-2d041bf0-b1da-42c3-8a0c-1eed074908d9 req-d40c1e30-c1b5-4ca5-82ca-35901f6a9c87 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] No waiting events found dispatching network-vif-plugged-9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:12:58 user nova-compute[72815]: WARNING nova.compute.manager [req-2d041bf0-b1da-42c3-8a0c-1eed074908d9 req-d40c1e30-c1b5-4ca5-82ca-35901f6a9c87 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Received unexpected event network-vif-plugged-9e4528ff-8473-4b16-90f7-d204b176cee2 for instance with vm_state active and task_state deleting.
Aug 17 20:12:59 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:12:59 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Took 1.24 seconds to deallocate network for instance.
Aug 17 20:13:00 user nova-compute[72815]: INFO nova.compute.manager [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Took 0.82 seconds to detach 1 volumes for instance.
Aug 17 20:13:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Deleting volume: da334dde-d96a-4550-9235-ca24be554e4d {{(pid=72815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 20:13:00 user nova-compute[72815]: DEBUG nova.compute.manager [req-50ff645a-fc4a-40b5-948a-ad758b5a1729 req-065d31ce-97e7-4a04-87a9-88562de11448 service nova] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Received event network-vif-deleted-9e4528ff-8473-4b16-90f7-d204b176cee2 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:00 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:13:00 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:13:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:01 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Deleted allocations for instance 167eb80d-4ac2-4b82-b3ab-897ac91247f2
Aug 17 20:13:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-cd24ec86-632c-481d-95d6-e1c9d46c2aff tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "167eb80d-4ac2-4b82-b3ab-897ac91247f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.992s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOIaufhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:13:02 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:13:02 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:13:02 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccae6f8-f683-4046-bccb-ac637f1a3fee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:13:02 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb46f4bd-156e-42fe-a57d-00f75070d1e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b] added
Aug 17 20:13:02 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[184a2bfc-848c-4c68-afdd-bade064ff6ae]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6db6c36-00f2-4137-8d10-9ce37fa73932]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOIaufhc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOIaufhc" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04d6d3d-da07-4a9d-b8ea-f7848d84e481]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dOIaufhc'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1994cd9-e71b-4a23-97f2-53f68ec8251e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b2ccb5-32ac-408e-8ec6-e14498c14c4a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:13:02 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:13:02 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:13:02 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:13:02 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d15ce94-3f35-4c99-988f-a384e7823fac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b, portal: 172.16.0.220,3260]
Aug 17 20:13:03 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b, portal: 172.16.0.220,3260] successful.
Aug 17 20:13:03 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc896f4-09ee-43e3-b0a7-57a59eef7846]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a1b650-dbdf-461d-b285-49e4c54b8912]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:13:03 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:13:03 user nova-compute[72815]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b (non-flash)
Aug 17 20:13:03 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:13:03 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:13:03 user nova-compute[72815]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b (non-flash)
Aug 17 20:13:03 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[26060992-d523-4c7f-94c3-13026d2e0e34]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:13:03 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOIaufhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:13:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:13:04 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23762333833383930', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:13:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762333833383930', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:13:04 user nova-compute[72815]: DEBUG nova.objects.instance [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lazy-loading 'flavor' on Instance uuid 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:13:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:13:04 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:13:04 user nova-compute[72815]:   <source dev="/dev/sdb"/>
Aug 17 20:13:04 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:13:04 user nova-compute[72815]:   <serial>2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b</serial>
Aug 17 20:13:04 user nova-compute[72815]: </disk>
Aug 17 20:13:04 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:13:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:13:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:13:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] No VIF found with MAC fa:16:3e:70:5f:c6, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:13:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b15601ba-b42a-4746-b836-15eef32b34b4 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.835s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:07 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303172.898319, ab784398-43df-4214-bdd3-22c652ac710f => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:13:07 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: ab784398-43df-4214-bdd3-22c652ac710f] VM Stopped (Lifecycle Event)
Aug 17 20:13:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-4d00a56f-fa49-4e44-8503-55be5a860237 None None] [instance: ab784398-43df-4214-bdd3-22c652ac710f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:13:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "1a714bfa-0b06-4ef8-865a-819abbc64be5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:10 user nova-compute[72815]: INFO nova.compute.manager [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Terminating instance
Aug 17 20:13:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:13:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-7e110f7a-1a63-4e4c-9d84-25e4b441b0ab req-6d24012d-b2a4-470e-9f78-ffd9d582b477 service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Received event network-vif-unplugged-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7e110f7a-1a63-4e4c-9d84-25e4b441b0ab req-6d24012d-b2a4-470e-9f78-ffd9d582b477 service nova] Acquiring lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7e110f7a-1a63-4e4c-9d84-25e4b441b0ab req-6d24012d-b2a4-470e-9f78-ffd9d582b477 service nova] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7e110f7a-1a63-4e4c-9d84-25e4b441b0ab req-6d24012d-b2a4-470e-9f78-ffd9d582b477 service nova] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-7e110f7a-1a63-4e4c-9d84-25e4b441b0ab req-6d24012d-b2a4-470e-9f78-ffd9d582b477 service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] No waiting events found dispatching network-vif-unplugged-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-7e110f7a-1a63-4e4c-9d84-25e4b441b0ab req-6d24012d-b2a4-470e-9f78-ffd9d582b477 service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Received event network-vif-unplugged-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:13:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Instance destroyed successfully.
Aug 17 20:13:11 user nova-compute[72815]: DEBUG nova.objects.instance [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lazy-loading 'resources' on Instance uuid 1a714bfa-0b06-4ef8-865a-819abbc64be5 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2026223806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2026223806',id=2,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:53:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89c20bd5232b4b058abc1b50f38cade3',ramdisk_id='',reservation_id='r-ur7p6puv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264619992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:55:26Z,user_data=None,user_id='169121564e514d4f883b71abeb3e6070',uuid=1a714bfa-0b06-4ef8-865a-819abbc64be5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converting VIF {"id": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "address": "fa:16:3e:60:de:83", "network": {"id": "19fecba5-e845-46d1-a2c1-246e74f90496", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1003361724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89c20bd5232b4b058abc1b50f38cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bdd8475-7e", "ovs_interfaceid": "0bdd8475-7ec8-4f5c-83ae-37ffa791a57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:de:83,bridge_name='br-int',has_traffic_filtering=True,id=0bdd8475-7ec8-4f5c-83ae-37ffa791a57c,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bdd8475-7e') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG os_vif [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:de:83,bridge_name='br-int',has_traffic_filtering=True,id=0bdd8475-7ec8-4f5c-83ae-37ffa791a57c,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bdd8475-7e') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bdd8475-7e, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:13:11 user nova-compute[72815]: INFO os_vif [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:de:83,bridge_name='br-int',has_traffic_filtering=True,id=0bdd8475-7ec8-4f5c-83ae-37ffa791a57c,network=Network(19fecba5-e845-46d1-a2c1-246e74f90496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bdd8475-7e')
Aug 17 20:13:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Deleting instance files /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5_del
Aug 17 20:13:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Deletion of /opt/stack/data/nova/instances/1a714bfa-0b06-4ef8-865a-819abbc64be5_del complete
Aug 17 20:13:11 user nova-compute[72815]: INFO nova.compute.manager [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 17 20:13:11 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:13:11 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:13:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:12 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:13:12 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Took 0.92 seconds to deallocate network for instance.
Aug 17 20:13:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-4d26e7cb-ae99-4972-b555-1abe441abfea req-f4cc7de8-9f64-4b55-8a21-7594125db606 service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Received event network-vif-deleted-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:12 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:13:12 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:13:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:12 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Deleted allocations for instance 1a714bfa-0b06-4ef8-865a-819abbc64be5
Aug 17 20:13:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b5440980-0ca7-4669-b629-388f89f404c0 tempest-ServerBootFromVolumeStableRescueTest-264619992 tempest-ServerBootFromVolumeStableRescueTest-264619992-project-member] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.131s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:12 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303177.9577286, 167eb80d-4ac2-4b82-b3ab-897ac91247f2 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:13:12 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] VM Stopped (Lifecycle Event)
Aug 17 20:13:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e03c3477-762f-4466-8c04-53430da427f4 None None] [instance: 167eb80d-4ac2-4b82-b3ab-897ac91247f2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:13:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-796d61cc-8feb-437f-858e-ecbc90142cb5 req-1e78b94e-13e8-4637-ba5f-0f18e3236e6d service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Received event network-vif-plugged-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-796d61cc-8feb-437f-858e-ecbc90142cb5 req-1e78b94e-13e8-4637-ba5f-0f18e3236e6d service nova] Acquiring lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-796d61cc-8feb-437f-858e-ecbc90142cb5 req-1e78b94e-13e8-4637-ba5f-0f18e3236e6d service nova] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-796d61cc-8feb-437f-858e-ecbc90142cb5 req-1e78b94e-13e8-4637-ba5f-0f18e3236e6d service nova] Lock "1a714bfa-0b06-4ef8-865a-819abbc64be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-796d61cc-8feb-437f-858e-ecbc90142cb5 req-1e78b94e-13e8-4637-ba5f-0f18e3236e6d service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] No waiting events found dispatching network-vif-plugged-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:13:13 user nova-compute[72815]: WARNING nova.compute.manager [req-796d61cc-8feb-437f-858e-ecbc90142cb5 req-1e78b94e-13e8-4637-ba5f-0f18e3236e6d service nova] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Received unexpected event network-vif-plugged-0bdd8475-7ec8-4f5c-83ae-37ffa791a57c for instance with vm_state deleted and task_state None.
Aug 17 20:13:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:15 user nova-compute[72815]: INFO nova.compute.manager [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Terminating instance
Aug 17 20:13:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-569e9efe-983f-4391-805c-0ecd90a299fb req-3020c583-4741-4ebf-b229-466d29f931a8 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Received event network-vif-unplugged-9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-569e9efe-983f-4391-805c-0ecd90a299fb req-3020c583-4741-4ebf-b229-466d29f931a8 service nova] Acquiring lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-569e9efe-983f-4391-805c-0ecd90a299fb req-3020c583-4741-4ebf-b229-466d29f931a8 service nova] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-569e9efe-983f-4391-805c-0ecd90a299fb req-3020c583-4741-4ebf-b229-466d29f931a8 service nova] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-569e9efe-983f-4391-805c-0ecd90a299fb req-3020c583-4741-4ebf-b229-466d29f931a8 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] No waiting events found dispatching network-vif-unplugged-9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:13:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-569e9efe-983f-4391-805c-0ecd90a299fb req-3020c583-4741-4ebf-b229-466d29f931a8 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Received event network-vif-unplugged-9955b382-2169-4d4e-a593-a85808d52584 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:13:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:16 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Instance destroyed successfully.
Aug 17 20:13:16 user nova-compute[72815]: DEBUG nova.objects.instance [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'resources' on Instance uuid b4462060-b172-4a3b-b9ed-d6b8514c8d97 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:13:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1870413469',display_name='tempest-AttachVolumeNegativeTest-server-1870413469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1870413469',id=38,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3QHZ4n34gdnKdzp6fxfrSwipSKR5dj0h0ieeyWuY8vqqzZgHUkSKr3VlsgwGCRRnvL82l4H6GStBRJ/u/eHI/ObcPTPsxYaw+KmE/eHbANBddcersfMZqtozitEhSRgQ==',key_name='tempest-keypair-1245324752',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ee9b4cae7404f3184fc480ffddfbbcd',ramdisk_id='',reservation_id='r-bmbkfxuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1950293532',owner_user_name='tempest-AttachVolumeNegativeTest-1950293532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a75e05392d54cfb9fcda786e3ee2efc',uuid=b4462060-b172-4a3b-b9ed-d6b8514c8d97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9955b382-2169-4d4e-a593-a85808d52584", "address": "fa:16:3e:4d:1b:d5", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9955b382-21", "ovs_interfaceid": "9955b382-2169-4d4e-a593-a85808d52584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:13:16 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converting VIF {"id": "9955b382-2169-4d4e-a593-a85808d52584", "address": "fa:16:3e:4d:1b:d5", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9955b382-21", "ovs_interfaceid": "9955b382-2169-4d4e-a593-a85808d52584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:13:16 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=9955b382-2169-4d4e-a593-a85808d52584,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9955b382-21') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:13:16 user nova-compute[72815]: DEBUG os_vif [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=9955b382-2169-4d4e-a593-a85808d52584,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9955b382-21') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:13:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9955b382-21, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:13:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:13:16 user nova-compute[72815]: INFO os_vif [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=9955b382-2169-4d4e-a593-a85808d52584,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9955b382-21')
Aug 17 20:13:16 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Deleting instance files /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97_del
Aug 17 20:13:16 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Deletion of /opt/stack/data/nova/instances/b4462060-b172-4a3b-b9ed-d6b8514c8d97_del complete
Aug 17 20:13:16 user nova-compute[72815]: INFO nova.compute.manager [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 20:13:16 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:13:16 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:13:16 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:13:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:17 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:13:17 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Took 1.00 seconds to deallocate network for instance.
Aug 17 20:13:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:17 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:13:17 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:13:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:17 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Deleted allocations for instance b4462060-b172-4a3b-b9ed-d6b8514c8d97
Aug 17 20:13:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-76ae1f96-52b6-469f-834d-18d5c61208c4 req-b7ab659f-3ca4-411f-b48a-21172120b084 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Received event network-vif-plugged-9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-76ae1f96-52b6-469f-834d-18d5c61208c4 req-b7ab659f-3ca4-411f-b48a-21172120b084 service nova] Acquiring lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-76ae1f96-52b6-469f-834d-18d5c61208c4 req-b7ab659f-3ca4-411f-b48a-21172120b084 service nova] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-76ae1f96-52b6-469f-834d-18d5c61208c4 req-b7ab659f-3ca4-411f-b48a-21172120b084 service nova] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-76ae1f96-52b6-469f-834d-18d5c61208c4 req-b7ab659f-3ca4-411f-b48a-21172120b084 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] No waiting events found dispatching network-vif-plugged-9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:13:17 user nova-compute[72815]: WARNING nova.compute.manager [req-76ae1f96-52b6-469f-834d-18d5c61208c4 req-b7ab659f-3ca4-411f-b48a-21172120b084 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Received unexpected event network-vif-plugged-9955b382-2169-4d4e-a593-a85808d52584 for instance with vm_state deleted and task_state None.
Aug 17 20:13:17 user nova-compute[72815]: DEBUG nova.compute.manager [req-76ae1f96-52b6-469f-834d-18d5c61208c4 req-b7ab659f-3ca4-411f-b48a-21172120b084 service nova] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Received event network-vif-deleted-9955b382-2169-4d4e-a593-a85808d52584 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c96e123d-f881-4582-88d1-1449315acb40 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "b4462060-b172-4a3b-b9ed-d6b8514c8d97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:13:22 user nova-compute[72815]: INFO nova.compute.claims [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Claim successful on node user
Aug 17 20:13:22 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG nova.network.neutron [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:13:22 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:13:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG nova.policy [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39ef6674029a4e51bfd614a9a834970c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adbeb02ec1e45b3b7c2af06e7cb92cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:13:22 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Creating image(s)
Aug 17 20:13:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "/opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "/opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "/opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "ea5016ba036bca475b022a43b98f716a30d5cf79" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "ea5016ba036bca475b022a43b98f716a30d5cf79" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79.part --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79.part --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG nova.virt.images [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] d056c8b4-77aa-433b-b557-9b79ffe99fcc was qcow2, converting to raw {{(pid=72815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79.part /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79.converted {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG nova.network.neutron [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Successfully created port: 331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79.part /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79.converted" returned: 0 in 0.211s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79.converted --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "ea5016ba036bca475b022a43b98f716a30d5cf79" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.910s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79 --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "ea5016ba036bca475b022a43b98f716a30d5cf79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "ea5016ba036bca475b022a43b98f716a30d5cf79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79 --force-share --output=json" returned: 0 in 0.175s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79,backing_fmt=raw /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79,backing_fmt=raw /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk 1073741824" returned: 0 in 0.056s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "ea5016ba036bca475b022a43b98f716a30d5cf79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79 --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Cannot resize image /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG nova.objects.instance [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'migration_context' on Instance uuid 0145191d-46b5-458c-9e04-136bd4635d40 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Ensure instance console log exists: /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG nova.network.neutron [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Successfully updated port: 331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquired lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG nova.network.neutron [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG nova.compute.manager [req-da987f89-fc5f-4b41-837d-a28b5dab10a5 req-4b1350e7-d7f9-46c8-ba1e-2bef046314be service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-changed-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG nova.compute.manager [req-da987f89-fc5f-4b41-837d-a28b5dab10a5 req-4b1350e7-d7f9-46c8-ba1e-2bef046314be service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Refreshing instance network info cache due to event network-changed-331a772e-61c5-4bbe-920e-f37642d7e012. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-da987f89-fc5f-4b41-837d-a28b5dab10a5 req-4b1350e7-d7f9-46c8-ba1e-2bef046314be service nova] Acquiring lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:13:24 user nova-compute[72815]: DEBUG nova.network.neutron [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.network.neutron [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updating instance_info_cache with network_info: [{"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Releasing lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.compute.manager [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Instance network_info: |[{"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-da987f89-fc5f-4b41-837d-a28b5dab10a5 req-4b1350e7-d7f9-46c8-ba1e-2bef046314be service nova] Acquired lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.network.neutron [req-da987f89-fc5f-4b41-837d-a28b5dab10a5 req-4b1350e7-d7f9-46c8-ba1e-2bef046314be service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Refreshing network info cache for port 331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Start _get_guest_xml network_info=[{"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T20:13:19Z,direct_url=<?>,disk_format='qcow2',id=d056c8b4-77aa-433b-b557-9b79ffe99fcc,min_disk=0,min_ram=0,name='tempest-scenario-img--1357905836',owner='6adbeb02ec1e45b3b7c2af06e7cb92cf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T20:13:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': 'd056c8b4-77aa-433b-b557-9b79ffe99fcc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:13:25 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:13:25 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T20:13:19Z,direct_url=<?>,disk_format='qcow2',id=d056c8b4-77aa-433b-b557-9b79ffe99fcc,min_disk=0,min_ram=0,name='tempest-scenario-img--1357905836',owner='6adbeb02ec1e45b3b7c2af06e7cb92cf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T20:13:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:13:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1572011402',display_name='tempest-TestMinimumBasicScenario-server-1572011402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1572011402',id=41,image_ref='d056c8b4-77aa-433b-b557-9b79ffe99fcc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdcKNFaoSkdo7iHnLFkpML2OqmZhygzWP0YgyuNWEYFJ0wwOw/haiTNxzu8cIy4BmFv2SBgmUKXfdh2hXXKSf9ZkedCiO5b5CHkbGKuCKDBgfrzwHUR4zJIN+6BM4lQRA==',key_name='tempest-TestMinimumBasicScenario-1144594707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6adbeb02ec1e45b3b7c2af06e7cb92cf',ramdisk_id='',reservation_id='r-s2sausqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d056c8b4-77aa-433b-b557-9b79ffe99fcc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1472868221',owner_user_name='tempest-TestMinimumBasicScenario-1472868221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:13:23Z,user_data=None,user_id='39ef6674029a4e51bfd614a9a834970c',uuid=0145191d-46b5-458c-9e04-136bd4635d40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converting VIF {"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.objects.instance [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'pci_devices' on Instance uuid 0145191d-46b5-458c-9e04-136bd4635d40 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:13:25 user nova-compute[72815]:   <uuid>0145191d-46b5-458c-9e04-136bd4635d40</uuid>
Aug 17 20:13:25 user nova-compute[72815]:   <name>instance-00000029</name>
Aug 17 20:13:25 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:13:25 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:13:25 user nova-compute[72815]:   <metadata>
Aug 17 20:13:25 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:13:25 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:13:25 user nova-compute[72815]:       <nova:name>tempest-TestMinimumBasicScenario-server-1572011402</nova:name>
Aug 17 20:13:25 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:13:25</nova:creationTime>
Aug 17 20:13:25 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:13:25 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:13:25 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:13:25 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:13:25 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:13:25 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:13:25 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:13:25 user nova-compute[72815]:       <nova:owner>
Aug 17 20:13:25 user nova-compute[72815]:         <nova:user uuid="39ef6674029a4e51bfd614a9a834970c">tempest-TestMinimumBasicScenario-1472868221-project-member</nova:user>
Aug 17 20:13:25 user nova-compute[72815]:         <nova:project uuid="6adbeb02ec1e45b3b7c2af06e7cb92cf">tempest-TestMinimumBasicScenario-1472868221</nova:project>
Aug 17 20:13:25 user nova-compute[72815]:       </nova:owner>
Aug 17 20:13:25 user nova-compute[72815]:       <nova:root type="image" uuid="d056c8b4-77aa-433b-b557-9b79ffe99fcc"/>
Aug 17 20:13:25 user nova-compute[72815]:       <nova:ports>
Aug 17 20:13:25 user nova-compute[72815]:         <nova:port uuid="331a772e-61c5-4bbe-920e-f37642d7e012">
Aug 17 20:13:25 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 20:13:25 user nova-compute[72815]:         </nova:port>
Aug 17 20:13:25 user nova-compute[72815]:       </nova:ports>
Aug 17 20:13:25 user nova-compute[72815]:     </nova:instance>
Aug 17 20:13:25 user nova-compute[72815]:   </metadata>
Aug 17 20:13:25 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:13:25 user nova-compute[72815]:     <system>
Aug 17 20:13:25 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:13:25 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:13:25 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:13:25 user nova-compute[72815]:       <entry name="serial">0145191d-46b5-458c-9e04-136bd4635d40</entry>
Aug 17 20:13:25 user nova-compute[72815]:       <entry name="uuid">0145191d-46b5-458c-9e04-136bd4635d40</entry>
Aug 17 20:13:25 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:13:25 user nova-compute[72815]:     </system>
Aug 17 20:13:25 user nova-compute[72815]:   </sysinfo>
Aug 17 20:13:25 user nova-compute[72815]:   <os>
Aug 17 20:13:25 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:13:25 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:13:25 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:13:25 user nova-compute[72815]:   </os>
Aug 17 20:13:25 user nova-compute[72815]:   <features>
Aug 17 20:13:25 user nova-compute[72815]:     <acpi/>
Aug 17 20:13:25 user nova-compute[72815]:     <apic/>
Aug 17 20:13:25 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:13:25 user nova-compute[72815]:   </features>
Aug 17 20:13:25 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:13:25 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:13:25 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:13:25 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:13:25 user nova-compute[72815]:   </clock>
Aug 17 20:13:25 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:13:25 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:13:25 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:13:25 user nova-compute[72815]:   </cpu>
Aug 17 20:13:25 user nova-compute[72815]:   <devices>
Aug 17 20:13:25 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:13:25 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:13:25 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk"/>
Aug 17 20:13:25 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:13:25 user nova-compute[72815]:     </disk>
Aug 17 20:13:25 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:13:25 user nova-compute[72815]:       <mac address="fa:16:3e:fa:90:a8"/>
Aug 17 20:13:25 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:13:25 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:13:25 user nova-compute[72815]:       <target dev="tap331a772e-61"/>
Aug 17 20:13:25 user nova-compute[72815]:     </interface>
Aug 17 20:13:25 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:13:25 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/console.log" append="off"/>
Aug 17 20:13:25 user nova-compute[72815]:     </serial>
Aug 17 20:13:25 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:13:25 user nova-compute[72815]:     <video>
Aug 17 20:13:25 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:13:25 user nova-compute[72815]:     </video>
Aug 17 20:13:25 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:13:25 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:13:25 user nova-compute[72815]:     </rng>
Aug 17 20:13:25 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:13:25 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:13:25 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:13:25 user nova-compute[72815]:     </memballoon>
Aug 17 20:13:25 user nova-compute[72815]:   </devices>
Aug 17 20:13:25 user nova-compute[72815]: </domain>
Aug 17 20:13:25 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:13:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1572011402',display_name='tempest-TestMinimumBasicScenario-server-1572011402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1572011402',id=41,image_ref='d056c8b4-77aa-433b-b557-9b79ffe99fcc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdcKNFaoSkdo7iHnLFkpML2OqmZhygzWP0YgyuNWEYFJ0wwOw/haiTNxzu8cIy4BmFv2SBgmUKXfdh2hXXKSf9ZkedCiO5b5CHkbGKuCKDBgfrzwHUR4zJIN+6BM4lQRA==',key_name='tempest-TestMinimumBasicScenario-1144594707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6adbeb02ec1e45b3b7c2af06e7cb92cf',ramdisk_id='',reservation_id='r-s2sausqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d056c8b4-77aa-433b-b557-9b79ffe99fcc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1472868221',owner_user_name='tempest-TestMinimumBasicScenario-1472868221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:13:23Z,user_data=None,user_id='39ef6674029a4e51bfd614a9a834970c',uuid=0145191d-46b5-458c-9e04-136bd4635d40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converting VIF {"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG os_vif [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap331a772e-61, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap331a772e-61, col_values=(('external_ids', {'iface-id': '331a772e-61c5-4bbe-920e-f37642d7e012', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:90:a8', 'vm-uuid': '0145191d-46b5-458c-9e04-136bd4635d40'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:25 user nova-compute[72815]: INFO os_vif [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61')
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] No VIF found with MAC fa:16:3e:fa:90:a8, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.network.neutron [req-da987f89-fc5f-4b41-837d-a28b5dab10a5 req-4b1350e7-d7f9-46c8-ba1e-2bef046314be service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updated VIF entry in instance network info cache for port 331a772e-61c5-4bbe-920e-f37642d7e012. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG nova.network.neutron [req-da987f89-fc5f-4b41-837d-a28b5dab10a5 req-4b1350e7-d7f9-46c8-ba1e-2bef046314be service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updating instance_info_cache with network_info: [{"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:13:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-da987f89-fc5f-4b41-837d-a28b5dab10a5 req-4b1350e7-d7f9-46c8-ba1e-2bef046314be service nova] Releasing lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:13:26 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303191.2479937, 1a714bfa-0b06-4ef8-865a-819abbc64be5 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:13:26 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] VM Stopped (Lifecycle Event)
Aug 17 20:13:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2b780381-f90d-49a8-93dd-9219dc6f8dd8 None None] [instance: 1a714bfa-0b06-4ef8-865a-819abbc64be5] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:13:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-375f2c21-357e-4236-af7d-e8980e8e3541 req-43a10d00-5cbc-4753-a659-b7473f059dd9 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-375f2c21-357e-4236-af7d-e8980e8e3541 req-43a10d00-5cbc-4753-a659-b7473f059dd9 service nova] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-375f2c21-357e-4236-af7d-e8980e8e3541 req-43a10d00-5cbc-4753-a659-b7473f059dd9 service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-375f2c21-357e-4236-af7d-e8980e8e3541 req-43a10d00-5cbc-4753-a659-b7473f059dd9 service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-375f2c21-357e-4236-af7d-e8980e8e3541 req-43a10d00-5cbc-4753-a659-b7473f059dd9 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] No waiting events found dispatching network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:13:26 user nova-compute[72815]: WARNING nova.compute.manager [req-375f2c21-357e-4236-af7d-e8980e8e3541 req-43a10d00-5cbc-4753-a659-b7473f059dd9 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received unexpected event network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 for instance with vm_state building and task_state spawning.
Aug 17 20:13:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303208.5978124, 0145191d-46b5-458c-9e04-136bd4635d40 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:13:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] VM Resumed (Lifecycle Event)
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:13:28 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Instance spawned successfully.
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:13:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303208.600559, 0145191d-46b5-458c-9e04-136bd4635d40 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:13:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] VM Started (Lifecycle Event)
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:13:28 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:13:28 user nova-compute[72815]: INFO nova.compute.manager [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Took 5.92 seconds to spawn the instance on the hypervisor.
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:13:28 user nova-compute[72815]: INFO nova.compute.manager [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Took 6.58 seconds to build instance.
Aug 17 20:13:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-43f6bd13-5907-42bb-bc4f-cf8ccf11db2e tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.664s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-4a7ec512-649d-4dc6-881b-9a2174ce1157 req-5ec1932c-80f0-41d7-8ae2-7b0dae292719 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4a7ec512-649d-4dc6-881b-9a2174ce1157 req-5ec1932c-80f0-41d7-8ae2-7b0dae292719 service nova] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4a7ec512-649d-4dc6-881b-9a2174ce1157 req-5ec1932c-80f0-41d7-8ae2-7b0dae292719 service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4a7ec512-649d-4dc6-881b-9a2174ce1157 req-5ec1932c-80f0-41d7-8ae2-7b0dae292719 service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-4a7ec512-649d-4dc6-881b-9a2174ce1157 req-5ec1932c-80f0-41d7-8ae2-7b0dae292719 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] No waiting events found dispatching network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:13:28 user nova-compute[72815]: WARNING nova.compute.manager [req-4a7ec512-649d-4dc6-881b-9a2174ce1157 req-5ec1932c-80f0-41d7-8ae2-7b0dae292719 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received unexpected event network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 for instance with vm_state active and task_state None.
Aug 17 20:13:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:31 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303196.4178724, b4462060-b172-4a3b-b9ed-d6b8514c8d97 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:13:31 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] VM Stopped (Lifecycle Event)
Aug 17 20:13:31 user nova-compute[72815]: DEBUG nova.compute.manager [None req-c1eadb88-5779-4a55-a6e7-3a6e94578de4 None None] [instance: b4462060-b172-4a3b-b9ed-d6b8514c8d97] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:13:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:33 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:13:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:13:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:13:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:13:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:13:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:39 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:13:39 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7636MB free_disk=25.326309204101562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 8ac64ac9-a49d-4c70-956b-3a140da5ede8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 99693a7e-71e3-4543-b649-41a147c77c7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance e7e09061-f65f-444b-98f6-409da28295e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 62614d4a-13bb-4c75-8f84-c47bdbf7b024 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 0145191d-46b5-458c-9e04-136bd4635d40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:13:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:13:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:13:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-8ac64ac9-a49d-4c70-956b-3a140da5ede8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:13:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-8ac64ac9-a49d-4c70-956b-3a140da5ede8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:13:41 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:13:42 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Updating instance_info_cache with network_info: [{"id": "049f8926-a1a3-431c-bf28-d08348e98b73", "address": "fa:16:3e:1f:94:21", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049f8926-a1", "ovs_interfaceid": "049f8926-a1a3-431c-bf28-d08348e98b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:13:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-8ac64ac9-a49d-4c70-956b-3a140da5ede8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:13:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:13:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:13:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:13:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:13:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:13:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:13:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:13:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:43 user nova-compute[72815]: DEBUG nova.objects.instance [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'flavor' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:13:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:13:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:44 user nova-compute[72815]: INFO nova.compute.manager [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Attaching volume 672b6717-38c5-4628-87c7-a107c6cbd408 to /dev/vdb
Aug 17 20:13:44 user nova-compute[72815]: DEBUG os_brick.utils [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[541c9e9a-58d6-411c-96a6-ddc248aab16d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb836eb-a9e9-475b-b163-bf3354cf951c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2fe073-9481-4a6e-a5f0-ef2c71e0a7f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3787be-f941-412f-9520-8e7997e4f0bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:13:44 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:13:44 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e164c893-abcb-48c5-bf26-c1757d563549]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG os_brick.utils [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:13:44 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updating existing volume attachment record: a79a0da8-2f03-4f1e-a3c0-dffdd9e60111 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:13:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:13:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:51 user nova-compute[72815]: INFO nova.compute.manager [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Detaching volume 2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b
Aug 17 20:13:52 user nova-compute[72815]: INFO nova.virt.block_device [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Attempting to driver detach volume 2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b from mountpoint /dev/vdb
Aug 17 20:13:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Attempting to detach device vdb from instance 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:13:52 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:13:52 user nova-compute[72815]:   <source dev="/dev/sdb"/>
Aug 17 20:13:52 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:13:52 user nova-compute[72815]:   <serial>2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b</serial>
Aug 17 20:13:52 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:13:52 user nova-compute[72815]: </disk>
Aug 17 20:13:52 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:13:52 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Successfully detached device vdb from instance 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 from the persistent domain config.
Aug 17 20:13:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:13:52 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:13:52 user nova-compute[72815]:   <source dev="/dev/sdb"/>
Aug 17 20:13:52 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:13:52 user nova-compute[72815]:   <serial>2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b</serial>
Aug 17 20:13:52 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:13:52 user nova-compute[72815]: </disk>
Aug 17 20:13:52 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692303232.4979105, 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:13:52 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Successfully detached device vdb from instance 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 from the live domain config.
Aug 17 20:13:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOIaufhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:13:52 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2eaae4-4def-495c-a33c-e9968114fbb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fe16bc-32c5-40f6-9453-effe71607da5]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:13:52 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:13:52 user nova-compute[72815]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b (non-flash)
Aug 17 20:13:52 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:13:52 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:13:52 user nova-compute[72815]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b (non-flash)
Aug 17 20:13:52 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994455fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b'): ({'sdb'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Removing single pathed devices sdb {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5755a3f6-ac0d-4e96-af3d-32c099d79e8e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-47b18b72-c8cc-4214-81b5-8d15982f8f3b req-b2a37c3b-d468-4f56-a9e2-5263f8735b56 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-changed-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-47b18b72-c8cc-4214-81b5-8d15982f8f3b req-b2a37c3b-d468-4f56-a9e2-5263f8735b56 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Refreshing instance network info cache due to event network-changed-7a6d3944-52f6-4ffc-81d1-f648b2b44f59. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47b18b72-c8cc-4214-81b5-8d15982f8f3b req-b2a37c3b-d468-4f56-a9e2-5263f8735b56 service nova] Acquiring lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47b18b72-c8cc-4214-81b5-8d15982f8f3b req-b2a37c3b-d468-4f56-a9e2-5263f8735b56 service nova] Acquired lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG nova.network.neutron [req-47b18b72-c8cc-4214-81b5-8d15982f8f3b req-b2a37c3b-d468-4f56-a9e2-5263f8735b56 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Refreshing network info cache for port 7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0287d4-c036-49c3-8766-9ffb729adf98]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Flushing IO for device /dev/sdb {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ce03e4-4b00-400a-b4d5-b50e0db675e1]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c747d32d-34a2-4d4c-bee6-d2d950b7b8c5]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2596ea-d94e-4869-86e7-30a27596f784]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01171ac-04f3-408e-bae3-0567bc4e5ba3]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b, portal: 172.16.0.220,3260]
Aug 17 20:13:52 user nova-compute[72815]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b, portal: 172.16.0.220,3260] successful.
Aug 17 20:13:52 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfddfce-be81-41c3-8093-764a623cdd5d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] <== disconnect_volume: return (328ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:13:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG nova.network.neutron [req-47b18b72-c8cc-4214-81b5-8d15982f8f3b req-b2a37c3b-d468-4f56-a9e2-5263f8735b56 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updated VIF entry in instance network info cache for port 7a6d3944-52f6-4ffc-81d1-f648b2b44f59. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG nova.network.neutron [req-47b18b72-c8cc-4214-81b5-8d15982f8f3b req-b2a37c3b-d468-4f56-a9e2-5263f8735b56 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updating instance_info_cache with network_info: [{"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47b18b72-c8cc-4214-81b5-8d15982f8f3b req-b2a37c3b-d468-4f56-a9e2-5263f8735b56 service nova] Releasing lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "e7e09061-f65f-444b-98f6-409da28295e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:53 user nova-compute[72815]: INFO nova.compute.manager [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Detaching volume 90e87f12-c09a-49cc-9b20-74249135b21f
Aug 17 20:13:53 user nova-compute[72815]: INFO nova.virt.block_device [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Attempting to driver detach volume 90e87f12-c09a-49cc-9b20-74249135b21f from mountpoint /dev/vdb
Aug 17 20:13:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Attempting to detach device vdb from instance e7e09061-f65f-444b-98f6-409da28295e2 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:13:53 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:13:53 user nova-compute[72815]:   <source dev="/dev/sdg"/>
Aug 17 20:13:53 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:13:53 user nova-compute[72815]:   <serial>90e87f12-c09a-49cc-9b20-74249135b21f</serial>
Aug 17 20:13:53 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:13:53 user nova-compute[72815]: </disk>
Aug 17 20:13:53 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:13:53 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Successfully detached device vdb from instance e7e09061-f65f-444b-98f6-409da28295e2 from the persistent domain config.
Aug 17 20:13:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e7e09061-f65f-444b-98f6-409da28295e2 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:13:53 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:13:53 user nova-compute[72815]:   <source dev="/dev/sdg"/>
Aug 17 20:13:53 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:13:53 user nova-compute[72815]:   <serial>90e87f12-c09a-49cc-9b20-74249135b21f</serial>
Aug 17 20:13:53 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:13:53 user nova-compute[72815]: </disk>
Aug 17 20:13:53 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lazy-loading 'flavor' on Instance uuid 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0244303c-061b-4988-b064-4afab00b427b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.875s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.739s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:53 user nova-compute[72815]: INFO nova.compute.manager [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Terminating instance
Aug 17 20:13:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692303233.845209, e7e09061-f65f-444b-98f6-409da28295e2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:13:53 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Successfully detached device vdb from instance e7e09061-f65f-444b-98f6-409da28295e2 from the live domain config.
Aug 17 20:13:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPrDyYGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:13:53 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:13:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0937b5-9f4c-48b7-94b6-e1dabe5af088]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b6d888-e583-4750-a5b3-f96d60890fe2]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:13:53 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:13:53 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:13:53 user nova-compute[72815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f (non-flash)
Aug 17 20:13:53 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b43d1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f'): ({'sdg'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Removing single pathed devices sdg {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a6c162-30ed-4fdd-ac44-2ab58218b4b8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[82121ec5-6db6-4386-982d-6459f34a0e09]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Flushing IO for device /dev/sdg {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:13:53 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21bff29-248c-4fef-bf88-ac6f74be52df]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:13:54 user nova-compute[72815]: INFO nova.compute.manager [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Terminating instance
Aug 17 20:13:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7ae550-1ba3-412c-a2fb-8e7c94224385]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] SCSI volumes sdg have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3097ea06-97bc-498b-9166-1c1cd301cd65]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a2309f-161f-448f-b82c-68184712d0cd]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f, portal: 172.16.0.220,3260]
Aug 17 20:13:54 user nova-compute[72815]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f, portal: 172.16.0.220,3260] successful.
Aug 17 20:13:54 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d193406d-1968-429a-9d26-ca51ede98243]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] <== disconnect_volume: return (337ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-f7117766-83a6-4ba4-ab54-f7a1db3d0c7d req-f8f70ddb-77a4-4cd3-9471-63e18d864598 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-changed-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-f7117766-83a6-4ba4-ab54-f7a1db3d0c7d req-f8f70ddb-77a4-4cd3-9471-63e18d864598 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Refreshing instance network info cache due to event network-changed-7a6d3944-52f6-4ffc-81d1-f648b2b44f59. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f7117766-83a6-4ba4-ab54-f7a1db3d0c7d req-f8f70ddb-77a4-4cd3-9471-63e18d864598 service nova] Acquiring lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f7117766-83a6-4ba4-ab54-f7a1db3d0c7d req-f8f70ddb-77a4-4cd3-9471-63e18d864598 service nova] Acquired lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:13:54 user nova-compute[72815]: DEBUG nova.network.neutron [req-f7117766-83a6-4ba4-ab54-f7a1db3d0c7d req-f8f70ddb-77a4-4cd3-9471-63e18d864598 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Refreshing network info cache for port 7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:13:55 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Instance destroyed successfully.
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.objects.instance [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lazy-loading 'resources' on Instance uuid 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2046194636',display_name='tempest-VolumesSnapshotTestJSON-instance-2046194636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2046194636',id=39,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBtf4jd1XSZOI1au8dbFM9qNlSm3HyCqG5LxzlmsQp2/1YBKzM0Xk7eRBOSYJBcC4xLMz+T9Ay17oSMSV+rGbyxoKa8Eithlc+UmeriAksPtESbX9kGUHazez+72XeMjg==',key_name='tempest-keypair-502977460',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d837d09a38d4d97a262d1ca77c00134',ramdisk_id='',reservation_id='r-euc8pa7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-30442452',owner_user_name='tempest-VolumesSnapshotTestJSON-30442452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b344ee6f91744dd79f8a884a9212da6b',uuid=4d1f0f1d-f55f-4aa3-b642-512ff95b5955,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5b95762-5800-49c5-9cf1-f8582b17c337", "address": "fa:16:3e:70:5f:c6", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b95762-58", "ovs_interfaceid": "d5b95762-5800-49c5-9cf1-f8582b17c337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Converting VIF {"id": "d5b95762-5800-49c5-9cf1-f8582b17c337", "address": "fa:16:3e:70:5f:c6", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b95762-58", "ovs_interfaceid": "d5b95762-5800-49c5-9cf1-f8582b17c337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:5f:c6,bridge_name='br-int',has_traffic_filtering=True,id=d5b95762-5800-49c5-9cf1-f8582b17c337,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b95762-58') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_vif [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:5f:c6,bridge_name='br-int',has_traffic_filtering=True,id=d5b95762-5800-49c5-9cf1-f8582b17c337,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b95762-58') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5b95762-58, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:13:55 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Instance destroyed successfully.
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.objects.instance [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lazy-loading 'resources' on Instance uuid 62614d4a-13bb-4c75-8f84-c47bdbf7b024 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:09:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-38227440',display_name='tempest-TestVolumeBootPattern-volume-backed-server-38227440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-38227440',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvzRwv1NeLsV63rdqwUQ1Eb1s71WFYyUOsy8khx7tMsvFjliKuYCsvWkbFvTF9akzGWfw7QEm1dusQH1Hh6NyShCCeD+nyC9m4msHasFVue0J2EqIglq0Rxjs41bG9D/A==',key_name='tempest-keypair-1245356691',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:09:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-6im7sz0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577ed0692a254a2fbd518e258563447f',uuid=62614d4a-13bb-4c75-8f84-c47bdbf7b024,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "address": "fa:16:3e:f6:fd:19", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf957619-7f", "ovs_interfaceid": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "address": "fa:16:3e:f6:fd:19", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf957619-7f", "ovs_interfaceid": "df957619-7f8e-4b2a-9dc8-7d7be2d09c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=df957619-7f8e-4b2a-9dc8-7d7be2d09c51,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf957619-7f') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_vif [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=df957619-7f8e-4b2a-9dc8-7d7be2d09c51,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf957619-7f') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:13:55 user nova-compute[72815]: INFO os_vif [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:5f:c6,bridge_name='br-int',has_traffic_filtering=True,id=d5b95762-5800-49c5-9cf1-f8582b17c337,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b95762-58')
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf957619-7f, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOIaufhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:13:55 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b845ccb-b5e8-42ba-8cd1-5b7283d04e0b', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:13:55 user nova-compute[72815]: INFO os_vif [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=df957619-7f8e-4b2a-9dc8-7d7be2d09c51,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf957619-7f')
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGXFpHNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:13:55 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cec650d-4c68-4bda-81d0-6e237d5f161e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e951357-8240-46d6-afac-8188795b2f03]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:13:55 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:13:55 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399420dab0>, {}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Disconnecting from: [] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] <== disconnect_volume: return (56ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:13:55 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Deleting instance files /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955_del
Aug 17 20:13:55 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Deletion of /opt/stack/data/nova/instances/4d1f0f1d-f55f-4aa3-b642-512ff95b5955_del complete
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.objects.instance [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'flavor' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.057s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6b4f21-cce7-4ea6-8ed6-058f5182f690]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ae985ab0-3908-460c-b8a7-adf99c6667c6 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "e7e09061-f65f-444b-98f6-409da28295e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.952s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e581b6c-1fd1-44d7-b47c-f36ded5501f9]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:13:55 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 (non-flash)
Aug 17 20:13:55 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f399444d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6'): ({'sde'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Removing single pathed devices sde {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad138e8c-aca6-40be-8cb8-8608d3846798]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:55 user nova-compute[72815]: INFO nova.compute.manager [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Took 1.44 seconds to destroy the instance on the hypervisor.
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d099e3eb-e3ad-4ffd-a863-ad0bf9a84d75]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flushing IO for device /dev/sde {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb0eac-3a77-4680-8195-eb2b5a797b9e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.069s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b756fe-1a8b-4d11-be1c-eda7424036a8]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc05dbd-0302-46ea-a606-1c510688a6cc]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[856fa4b2-2170-406c-910f-df37efbf8e1b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6, portal: 172.16.0.220,3260]
Aug 17 20:13:55 user nova-compute[72815]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6, portal: 172.16.0.220,3260] successful.
Aug 17 20:13:55 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c793022-8723-4434-8a22-14cbc10656d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf00653-c455-4349-bfbf-035fea3924e3]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== disconnect_volume: return (393ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:13:55 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Deleting instance files /opt/stack/data/nova/instances/62614d4a-13bb-4c75-8f84-c47bdbf7b024_del
Aug 17 20:13:55 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Deletion of /opt/stack/data/nova/instances/62614d4a-13bb-4c75-8f84-c47bdbf7b024_del complete
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.volume.cinder [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Update attachment failed for attachment a79a0da8-2f03-4f1e-a3c0-dffdd9e60111. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:672b6717-38c5-4628-87c7-a107c6cbd408 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:672b6717-38c5-4628-87c7-a107c6cbd408/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f was not found.).). (HTTP 500) (Request-ID: req-97025e98-e76e-4479-aa26-d0e48174185b) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:672b6717-38c5-4628-87c7-a107c6cbd408 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:672b6717-38c5-4628-87c7-a107c6cbd408/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f was not found.).). (HTTP 500) (Request-ID: req-97025e98-e76e-4479-aa26-d0e48174185b)
Aug 17 20:13:55 user nova-compute[72815]: INFO nova.compute.manager [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Took 1.59 seconds to destroy the instance on the hypervisor.
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Failed to attach 672b6717-38c5-4628-87c7-a107c6cbd408 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:672b6717-38c5-4628-87c7-a107c6cbd408 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:672b6717-38c5-4628-87c7-a107c6cbd408/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f was not found.).). (HTTP 500) (Request-ID: req-97025e98-e76e-4479-aa26-d0e48174185b)
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Traceback (most recent call last):
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     ret_val = method(obj, context, *args, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     self._do_attach(context, instance, volume, volume_api,
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     self._volume_attach(context, volume, connector, instance,
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     connection_info = volume_api.attachment_update(
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     res = method(self, ctx, *args, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     with excutils.save_and_reraise_exception():
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     self.force_reraise()
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     raise self.value
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     return method.func(obj, *args, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     resp = self._update('/attachments/%s' % id, body)
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     return self.request(url, method, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e]     raise exceptions.from_response(resp, body)
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:672b6717-38c5-4628-87c7-a107c6cbd408 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:672b6717-38c5-4628-87c7-a107c6cbd408/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f was not found.).). (HTTP 500) (Request-ID: req-97025e98-e76e-4479-aa26-d0e48174185b)
Aug 17 20:13:55 user nova-compute[72815]: ERROR nova.compute.manager [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] 
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.640s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server [None req-591aaaba-ab24-4ef0-8170-9d668653e21c tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:672b6717-38c5-4628-87c7-a107c6cbd408 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:672b6717-38c5-4628-87c7-a107c6cbd408/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f was not found.).). (HTTP 500) (Request-ID: req-97025e98-e76e-4479-aa26-d0e48174185b)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:672b6717-38c5-4628-87c7-a107c6cbd408 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:672b6717-38c5-4628-87c7-a107c6cbd408/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:90e87f12-c09a-49cc-9b20-74249135b21f was not found.).). (HTTP 500) (Request-ID: req-97025e98-e76e-4479-aa26-d0e48174185b)
Aug 17 20:13:55 user nova-compute[72815]: ERROR oslo_messaging.rpc.server 
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.network.neutron [req-f7117766-83a6-4ba4-ab54-f7a1db3d0c7d req-f8f70ddb-77a4-4cd3-9471-63e18d864598 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updated VIF entry in instance network info cache for port 7a6d3944-52f6-4ffc-81d1-f648b2b44f59. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG nova.network.neutron [req-f7117766-83a6-4ba4-ab54-f7a1db3d0c7d req-f8f70ddb-77a4-4cd3-9471-63e18d864598 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updating instance_info_cache with network_info: [{"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:13:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f7117766-83a6-4ba4-ab54-f7a1db3d0c7d req-f8f70ddb-77a4-4cd3-9471-63e18d864598 service nova] Releasing lock "refresh_cache-e7e09061-f65f-444b-98f6-409da28295e2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:13:56 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:13:56 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Took 0.96 seconds to deallocate network for instance.
Aug 17 20:13:56 user nova-compute[72815]: WARNING nova.volume.cinder [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Attachment 05c37d68-9263-4c1f-a0b8-8582020b73f8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 05c37d68-9263-4c1f-a0b8-8582020b73f8. (HTTP 404) (Request-ID: req-003ad352-d02e-47bd-9104-8f2b31b2ab3b)
Aug 17 20:13:56 user nova-compute[72815]: INFO nova.compute.manager [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Took 0.03 seconds to detach 1 volumes for instance.
Aug 17 20:13:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:56 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:13:56 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:13:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:56 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Deleted allocations for instance 4d1f0f1d-f55f-4aa3-b642-512ff95b5955
Aug 17 20:13:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-694e27dd-98b6-4c81-ad06-1aef8315f13e tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4d1f0f1d-f55f-4aa3-b642-512ff95b5955" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.940s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-6d3d96d9-23d8-4821-af0f-7fc7dc29d3ba req-3855f601-69cd-4d51-8c11-85c2b3ba62e8 service nova] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Received event network-vif-deleted-d5b95762-5800-49c5-9cf1-f8582b17c337 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:57 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:13:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-a98e57ac-f237-4ef2-9784-663e6df59b00 req-c3c25d97-0df1-4a00-ba32-0bcf5935c745 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Received event network-vif-deleted-df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:57 user nova-compute[72815]: INFO nova.compute.manager [req-a98e57ac-f237-4ef2-9784-663e6df59b00 req-c3c25d97-0df1-4a00-ba32-0bcf5935c745 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Neutron deleted interface df957619-7f8e-4b2a-9dc8-7d7be2d09c51; detaching it from the instance and deleting it from the info cache
Aug 17 20:13:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-a98e57ac-f237-4ef2-9784-663e6df59b00 req-c3c25d97-0df1-4a00-ba32-0bcf5935c745 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:13:57 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Took 1.63 seconds to deallocate network for instance.
Aug 17 20:13:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-a98e57ac-f237-4ef2-9784-663e6df59b00 req-c3c25d97-0df1-4a00-ba32-0bcf5935c745 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Detach interface failed, port_id=df957619-7f8e-4b2a-9dc8-7d7be2d09c51, reason: Instance 62614d4a-13bb-4c75-8f84-c47bdbf7b024 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:13:58 user nova-compute[72815]: INFO nova.compute.manager [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Took 0.76 seconds to detach 1 volumes for instance.
Aug 17 20:13:58 user nova-compute[72815]: DEBUG nova.compute.manager [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Deleting volume: 6c793022-8723-4434-8a22-14cbc10656d6 {{(pid=72815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 20:13:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:13:58 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:13:58 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:13:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:58 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Deleted allocations for instance 62614d4a-13bb-4c75-8f84-c47bdbf7b024
Aug 17 20:13:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-b77597bd-2b42-4353-9994-9f530d4da9b6 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.501s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-f8fc4355-a137-4990-868d-631aa94076d2 req-4654ddab-3289-4c4b-ac21-2cb0053fefe9 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Received event network-vif-plugged-df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:13:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f8fc4355-a137-4990-868d-631aa94076d2 req-4654ddab-3289-4c4b-ac21-2cb0053fefe9 service nova] Acquiring lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:13:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f8fc4355-a137-4990-868d-631aa94076d2 req-4654ddab-3289-4c4b-ac21-2cb0053fefe9 service nova] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:13:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f8fc4355-a137-4990-868d-631aa94076d2 req-4654ddab-3289-4c4b-ac21-2cb0053fefe9 service nova] Lock "62614d4a-13bb-4c75-8f84-c47bdbf7b024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:13:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-f8fc4355-a137-4990-868d-631aa94076d2 req-4654ddab-3289-4c4b-ac21-2cb0053fefe9 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] No waiting events found dispatching network-vif-plugged-df957619-7f8e-4b2a-9dc8-7d7be2d09c51 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:13:58 user nova-compute[72815]: WARNING nova.compute.manager [req-f8fc4355-a137-4990-868d-631aa94076d2 req-4654ddab-3289-4c4b-ac21-2cb0053fefe9 service nova] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Received unexpected event network-vif-plugged-df957619-7f8e-4b2a-9dc8-7d7be2d09c51 for instance with vm_state deleted and task_state None.
Aug 17 20:14:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303235.0051906, 4d1f0f1d-f55f-4aa3-b642-512ff95b5955 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:14:10 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] VM Stopped (Lifecycle Event)
Aug 17 20:14:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-3d6c63dc-7f1e-4abe-9749-611d7aada118 None None] [instance: 4d1f0f1d-f55f-4aa3-b642-512ff95b5955] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303235.067867, 62614d4a-13bb-4c75-8f84-c47bdbf7b024 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:14:10 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] VM Stopped (Lifecycle Event)
Aug 17 20:14:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-187fedf8-cceb-43e7-8b42-bb926b1f6223 None None] [instance: 62614d4a-13bb-4c75-8f84-c47bdbf7b024] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "37ce6156-441f-4e86-89c1-9a3b1590df47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:14:10 user nova-compute[72815]: INFO nova.compute.claims [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Claim successful on node user
Aug 17 20:14:10 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:14:10 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:14:10 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:14:10 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG nova.policy [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a75e05392d54cfb9fcda786e3ee2efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9b4cae7404f3184fc480ffddfbbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:14:11 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Creating image(s)
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "/opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "/opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "/opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.213s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:14:11 user nova-compute[72815]: INFO nova.compute.claims [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Claim successful on node user
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk 1073741824" returned: 0 in 0.066s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.226s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Successfully created port: 36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:14:11 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Cannot resize image /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'migration_context' on Instance uuid 37ce6156-441f-4e86-89c1-9a3b1590df47 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Ensure instance console log exists: /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:14:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.policy [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3fc7666dca14c5791054aa3cb89ebb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd85890dbab214814b52076eb232cac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:14:12 user nova-compute[72815]: INFO nova.virt.block_device [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Booting with volume a87d5356-8d0f-4d8d-97c1-863f303090ea at /dev/vda
Aug 17 20:14:12 user nova-compute[72815]: DEBUG os_brick.utils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[669c77ac-a436-4e35-8f7d-9629d2348f07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8ee042-166e-468d-8789-e650ca6e1ff1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a75f6f-8138-4d3d-83a2-3ff67d2f33e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b4bdca-8ad7-4d05-a452-3e26bb69fee0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:14:12 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4f6581-4c3d-4349-9da1-87d5456fc30f]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG os_brick.utils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Updating existing volume attachment record: 5b44d6cb-7714-4719-bc1e-80ecc9499331 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Successfully updated port: 36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "refresh_cache-37ce6156-441f-4e86-89c1-9a3b1590df47" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquired lock "refresh_cache-37ce6156-441f-4e86-89c1-9a3b1590df47" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Successfully created port: 9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:14:12 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-16393612-b966-4024-90e1-bdb2c766f910 req-cb48b260-b7d5-440c-8264-45000828e7fa service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Received event network-changed-36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-16393612-b966-4024-90e1-bdb2c766f910 req-cb48b260-b7d5-440c-8264-45000828e7fa service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Refreshing instance network info cache due to event network-changed-36bdea48-bb16-4017-9627-8c87a2fa6d13. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-16393612-b966-4024-90e1-bdb2c766f910 req-cb48b260-b7d5-440c-8264-45000828e7fa service nova] Acquiring lock "refresh_cache-37ce6156-441f-4e86-89c1-9a3b1590df47" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Updating instance_info_cache with network_info: [{"id": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "address": "fa:16:3e:8b:a3:dc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36bdea48-bb", "ovs_interfaceid": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Releasing lock "refresh_cache-37ce6156-441f-4e86-89c1-9a3b1590df47" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Instance network_info: |[{"id": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "address": "fa:16:3e:8b:a3:dc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36bdea48-bb", "ovs_interfaceid": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-16393612-b966-4024-90e1-bdb2c766f910 req-cb48b260-b7d5-440c-8264-45000828e7fa service nova] Acquired lock "refresh_cache-37ce6156-441f-4e86-89c1-9a3b1590df47" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-16393612-b966-4024-90e1-bdb2c766f910 req-cb48b260-b7d5-440c-8264-45000828e7fa service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Refreshing network info cache for port 36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Start _get_guest_xml network_info=[{"id": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "address": "fa:16:3e:8b:a3:dc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36bdea48-bb", "ovs_interfaceid": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:14:13 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:14:13 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2042324172',display_name='tempest-AttachVolumeNegativeTest-server-2042324172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2042324172',id=42,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/vWM/347DvEF63SKo0JMPz8i1x2fjPhlD6nchXyYEweMGkGJJC4fxSFRWVxWAo6ikbB46MwlpdGDVQSG4fuds/aAXOLhAdsGMrYBAvoywhElRsBeVLLOu6sbkmoQ/1Pg==',key_name='tempest-keypair-1442516895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ee9b4cae7404f3184fc480ffddfbbcd',ramdisk_id='',reservation_id='r-daktq2o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1950293532',owner_user_name='tempest-AttachVolumeNegativeTest-1950293532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:14:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a75e05392d54cfb9fcda786e3ee2efc',uuid=37ce6156-441f-4e86-89c1-9a3b1590df47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "address": "fa:16:3e:8b:a3:dc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36bdea48-bb", "ovs_interfaceid": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converting VIF {"id": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "address": "fa:16:3e:8b:a3:dc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36bdea48-bb", "ovs_interfaceid": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:a3:dc,bridge_name='br-int',has_traffic_filtering=True,id=36bdea48-bb16-4017-9627-8c87a2fa6d13,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36bdea48-bb') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.objects.instance [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'pci_devices' on Instance uuid 37ce6156-441f-4e86-89c1-9a3b1590df47 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:14:13 user nova-compute[72815]:   <uuid>37ce6156-441f-4e86-89c1-9a3b1590df47</uuid>
Aug 17 20:14:13 user nova-compute[72815]:   <name>instance-0000002a</name>
Aug 17 20:14:13 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:14:13 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:14:13 user nova-compute[72815]:   <metadata>
Aug 17 20:14:13 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:14:13 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:14:13 user nova-compute[72815]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2042324172</nova:name>
Aug 17 20:14:13 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:14:13</nova:creationTime>
Aug 17 20:14:13 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:14:13 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:14:13 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:14:13 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:14:13 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:14:13 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:14:13 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:14:13 user nova-compute[72815]:       <nova:owner>
Aug 17 20:14:13 user nova-compute[72815]:         <nova:user uuid="2a75e05392d54cfb9fcda786e3ee2efc">tempest-AttachVolumeNegativeTest-1950293532-project-member</nova:user>
Aug 17 20:14:13 user nova-compute[72815]:         <nova:project uuid="9ee9b4cae7404f3184fc480ffddfbbcd">tempest-AttachVolumeNegativeTest-1950293532</nova:project>
Aug 17 20:14:13 user nova-compute[72815]:       </nova:owner>
Aug 17 20:14:13 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:14:13 user nova-compute[72815]:       <nova:ports>
Aug 17 20:14:13 user nova-compute[72815]:         <nova:port uuid="36bdea48-bb16-4017-9627-8c87a2fa6d13">
Aug 17 20:14:13 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 20:14:13 user nova-compute[72815]:         </nova:port>
Aug 17 20:14:13 user nova-compute[72815]:       </nova:ports>
Aug 17 20:14:13 user nova-compute[72815]:     </nova:instance>
Aug 17 20:14:13 user nova-compute[72815]:   </metadata>
Aug 17 20:14:13 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:14:13 user nova-compute[72815]:     <system>
Aug 17 20:14:13 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:14:13 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:14:13 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:14:13 user nova-compute[72815]:       <entry name="serial">37ce6156-441f-4e86-89c1-9a3b1590df47</entry>
Aug 17 20:14:13 user nova-compute[72815]:       <entry name="uuid">37ce6156-441f-4e86-89c1-9a3b1590df47</entry>
Aug 17 20:14:13 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:14:13 user nova-compute[72815]:     </system>
Aug 17 20:14:13 user nova-compute[72815]:   </sysinfo>
Aug 17 20:14:13 user nova-compute[72815]:   <os>
Aug 17 20:14:13 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:14:13 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:14:13 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:14:13 user nova-compute[72815]:   </os>
Aug 17 20:14:13 user nova-compute[72815]:   <features>
Aug 17 20:14:13 user nova-compute[72815]:     <acpi/>
Aug 17 20:14:13 user nova-compute[72815]:     <apic/>
Aug 17 20:14:13 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:14:13 user nova-compute[72815]:   </features>
Aug 17 20:14:13 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:14:13 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:14:13 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:14:13 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:14:13 user nova-compute[72815]:   </clock>
Aug 17 20:14:13 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:14:13 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:14:13 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:14:13 user nova-compute[72815]:   </cpu>
Aug 17 20:14:13 user nova-compute[72815]:   <devices>
Aug 17 20:14:13 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:14:13 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:14:13 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk"/>
Aug 17 20:14:13 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:14:13 user nova-compute[72815]:     </disk>
Aug 17 20:14:13 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:14:13 user nova-compute[72815]:       <mac address="fa:16:3e:8b:a3:dc"/>
Aug 17 20:14:13 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:14:13 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:14:13 user nova-compute[72815]:       <target dev="tap36bdea48-bb"/>
Aug 17 20:14:13 user nova-compute[72815]:     </interface>
Aug 17 20:14:13 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:14:13 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/console.log" append="off"/>
Aug 17 20:14:13 user nova-compute[72815]:     </serial>
Aug 17 20:14:13 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:14:13 user nova-compute[72815]:     <video>
Aug 17 20:14:13 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:14:13 user nova-compute[72815]:     </video>
Aug 17 20:14:13 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:14:13 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:14:13 user nova-compute[72815]:     </rng>
Aug 17 20:14:13 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:14:13 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:14:13 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:14:13 user nova-compute[72815]:     </memballoon>
Aug 17 20:14:13 user nova-compute[72815]:   </devices>
Aug 17 20:14:13 user nova-compute[72815]: </domain>
Aug 17 20:14:13 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2042324172',display_name='tempest-AttachVolumeNegativeTest-server-2042324172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2042324172',id=42,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/vWM/347DvEF63SKo0JMPz8i1x2fjPhlD6nchXyYEweMGkGJJC4fxSFRWVxWAo6ikbB46MwlpdGDVQSG4fuds/aAXOLhAdsGMrYBAvoywhElRsBeVLLOu6sbkmoQ/1Pg==',key_name='tempest-keypair-1442516895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ee9b4cae7404f3184fc480ffddfbbcd',ramdisk_id='',reservation_id='r-daktq2o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1950293532',owner_user_name='tempest-AttachVolumeNegativeTest-1950293532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:14:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a75e05392d54cfb9fcda786e3ee2efc',uuid=37ce6156-441f-4e86-89c1-9a3b1590df47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "address": "fa:16:3e:8b:a3:dc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36bdea48-bb", "ovs_interfaceid": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converting VIF {"id": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "address": "fa:16:3e:8b:a3:dc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36bdea48-bb", "ovs_interfaceid": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:a3:dc,bridge_name='br-int',has_traffic_filtering=True,id=36bdea48-bb16-4017-9627-8c87a2fa6d13,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36bdea48-bb') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG os_vif [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:a3:dc,bridge_name='br-int',has_traffic_filtering=True,id=36bdea48-bb16-4017-9627-8c87a2fa6d13,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36bdea48-bb') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36bdea48-bb, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36bdea48-bb, col_values=(('external_ids', {'iface-id': '36bdea48-bb16-4017-9627-8c87a2fa6d13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:a3:dc', 'vm-uuid': '37ce6156-441f-4e86-89c1-9a3b1590df47'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:13 user nova-compute[72815]: INFO os_vif [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:a3:dc,bridge_name='br-int',has_traffic_filtering=True,id=36bdea48-bb16-4017-9627-8c87a2fa6d13,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36bdea48-bb')
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No VIF found with MAC fa:16:3e:8b:a3:dc, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.network.neutron [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Successfully updated port: 9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "refresh_cache-eb1a22c1-175e-480f-9ddf-cd297df993c8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquired lock "refresh_cache-eb1a22c1-175e-480f-9ddf-cd297df993c8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.network.neutron [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-a5e51c2d-242a-4104-824b-878b627721f3 req-e1f24c56-fa46-45b9-890f-a6dbe4466d08 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event network-changed-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-a5e51c2d-242a-4104-824b-878b627721f3 req-e1f24c56-fa46-45b9-890f-a6dbe4466d08 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Refreshing instance network info cache due to event network-changed-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a5e51c2d-242a-4104-824b-878b627721f3 req-e1f24c56-fa46-45b9-890f-a6dbe4466d08 service nova] Acquiring lock "refresh_cache-eb1a22c1-175e-480f-9ddf-cd297df993c8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.network.neutron [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-16393612-b966-4024-90e1-bdb2c766f910 req-cb48b260-b7d5-440c-8264-45000828e7fa service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Updated VIF entry in instance network info cache for port 36bdea48-bb16-4017-9627-8c87a2fa6d13. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG nova.network.neutron [req-16393612-b966-4024-90e1-bdb2c766f910 req-cb48b260-b7d5-440c-8264-45000828e7fa service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Updating instance_info_cache with network_info: [{"id": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "address": "fa:16:3e:8b:a3:dc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36bdea48-bb", "ovs_interfaceid": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:14:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-16393612-b966-4024-90e1-bdb2c766f910 req-cb48b260-b7d5-440c-8264-45000828e7fa service nova] Releasing lock "refresh_cache-37ce6156-441f-4e86-89c1-9a3b1590df47" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG nova.network.neutron [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Updating instance_info_cache with network_info: [{"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Releasing lock "refresh_cache-eb1a22c1-175e-480f-9ddf-cd297df993c8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG nova.compute.manager [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Instance network_info: |[{"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a5e51c2d-242a-4104-824b-878b627721f3 req-e1f24c56-fa46-45b9-890f-a6dbe4466d08 service nova] Acquired lock "refresh_cache-eb1a22c1-175e-480f-9ddf-cd297df993c8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG nova.network.neutron [req-a5e51c2d-242a-4104-824b-878b627721f3 req-e1f24c56-fa46-45b9-890f-a6dbe4466d08 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Refreshing network info cache for port 9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG nova.network.neutron [req-a5e51c2d-242a-4104-824b-878b627721f3 req-e1f24c56-fa46-45b9-890f-a6dbe4466d08 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Updated VIF entry in instance network info cache for port 9d809bd7-984f-4bdd-8d4c-76fbe05ec68c. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG nova.network.neutron [req-a5e51c2d-242a-4104-824b-878b627721f3 req-e1f24c56-fa46-45b9-890f-a6dbe4466d08 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Updating instance_info_cache with network_info: [{"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a5e51c2d-242a-4104-824b-878b627721f3 req-e1f24c56-fa46-45b9-890f-a6dbe4466d08 service nova] Releasing lock "refresh_cache-eb1a22c1-175e-480f-9ddf-cd297df993c8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG nova.compute.manager [req-de984b3a-184e-438f-ad2e-b8c6b31c2acf req-b51375cf-1a71-45a4-ae04-bb9414edbaa6 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Received event network-vif-plugged-36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-de984b3a-184e-438f-ad2e-b8c6b31c2acf req-b51375cf-1a71-45a4-ae04-bb9414edbaa6 service nova] Acquiring lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-de984b3a-184e-438f-ad2e-b8c6b31c2acf req-b51375cf-1a71-45a4-ae04-bb9414edbaa6 service nova] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-de984b3a-184e-438f-ad2e-b8c6b31c2acf req-b51375cf-1a71-45a4-ae04-bb9414edbaa6 service nova] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:14 user nova-compute[72815]: DEBUG nova.compute.manager [req-de984b3a-184e-438f-ad2e-b8c6b31c2acf req-b51375cf-1a71-45a4-ae04-bb9414edbaa6 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] No waiting events found dispatching network-vif-plugged-36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:14:14 user nova-compute[72815]: WARNING nova.compute.manager [req-de984b3a-184e-438f-ad2e-b8c6b31c2acf req-b51375cf-1a71-45a4-ae04-bb9414edbaa6 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Received unexpected event network-vif-plugged-36bdea48-bb16-4017-9627-8c87a2fa6d13 for instance with vm_state building and task_state spawning.
Aug 17 20:14:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303256.8686922, 37ce6156-441f-4e86-89c1-9a3b1590df47 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:14:16 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] VM Resumed (Lifecycle Event)
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:14:16 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Instance spawned successfully.
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:14:16 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303256.8699892, 37ce6156-441f-4e86-89c1-9a3b1590df47 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:14:16 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] VM Started (Lifecycle Event)
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-01faf827-3696-4ef2-9e69-aecefb657a6f req-d9906a42-a216-4568-a76a-a25289ae7124 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Received event network-vif-plugged-36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-01faf827-3696-4ef2-9e69-aecefb657a6f req-d9906a42-a216-4568-a76a-a25289ae7124 service nova] Acquiring lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-01faf827-3696-4ef2-9e69-aecefb657a6f req-d9906a42-a216-4568-a76a-a25289ae7124 service nova] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-01faf827-3696-4ef2-9e69-aecefb657a6f req-d9906a42-a216-4568-a76a-a25289ae7124 service nova] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-01faf827-3696-4ef2-9e69-aecefb657a6f req-d9906a42-a216-4568-a76a-a25289ae7124 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] No waiting events found dispatching network-vif-plugged-36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:14:16 user nova-compute[72815]: WARNING nova.compute.manager [req-01faf827-3696-4ef2-9e69-aecefb657a6f req-d9906a42-a216-4568-a76a-a25289ae7124 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Received unexpected event network-vif-plugged-36bdea48-bb16-4017-9627-8c87a2fa6d13 for instance with vm_state building and task_state spawning.
Aug 17 20:14:16 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:14:16 user nova-compute[72815]: INFO nova.compute.manager [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Took 5.85 seconds to spawn the instance on the hypervisor.
Aug 17 20:14:16 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:14:17 user nova-compute[72815]: INFO nova.compute.manager [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Took 6.62 seconds to build instance.
Aug 17 20:14:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e3e844d0-256d-4101-9548-f21b311f4c4f tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.795s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:14:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.compute.manager [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:14:33 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Creating image(s)
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Ensure instance console log exists: /opt/stack/data/nova/instances/eb1a22c1-175e-480f-9ddf-cd297df993c8/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Start _get_guest_xml network_info=[{"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '5b44d6cb-7714-4719-bc1e-80ecc9499331', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHyCLGeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb1a22c1-175e-480f-9ddf-cd297df993c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a87d5356-8d0f-4d8d-97c1-863f303090ea', 'serial': 'a87d5356-8d0f-4d8d-97c1-863f303090ea'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:14:33 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:14:33 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:14:33 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHyCLGeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:14:34 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:14:34 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:14:34 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[14821842-d1e2-4bfc-a79a-a9d9ee4853d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:14:34 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf85053d-974e-4bde-af11-79604908692a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea] added
Aug 17 20:14:34 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d9df53-4aab-4f81-a131-7887b58cc9da]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[39edc7c2-b034-46c5-997c-b327d1c2fc49]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHyCLGeo {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHyCLGeo" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72062d8a-422c-4bd4-b79e-08b3bce8600e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iHyCLGeo'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[599a57f2-d694-4f98-a81b-9d1c49b7e1d6]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f548a9ed-05ed-47a1-b739-9d2785d4608f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 20:14:34 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 20:14:34 user nova-compute[72815]:  {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:14:34 user nova-compute[72815]: WARNING os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 20:14:34 user nova-compute[72815]: 
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bac21b-b690-49aa-a50a-4524479acc2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260]
Aug 17 20:14:34 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260] successful.
Aug 17 20:14:34 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedd16db-879e-4997-9908-ed90e1929322]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca82709-42cd-49c0-b5bb-fdffc276c713]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:14:34 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:14:34 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6d0d7c-128e-4355-a3ed-fdc59bd5173f]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:14:34 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHyCLGeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26531323635383432', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531323635383432', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1306781066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1306781066',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT7QCi8nId/iu4W4vvmCjsuZSx5jxi+6/A/TppcD7spua4Voq9EKV3Cbyn1NISMYCmgMHcmF2qyJPdVxn7gfwy+H7ZUMeDJ7/t4NxqxTvVHfq3jjyoTa4Leb+MiNll4+g==',key_name='tempest-keypair-1418290547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d85890dbab214814b52076eb232cac3f',ramdisk_id='',reservation_id='r-nkq44203',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-568249167',owner_user_name='tempest-ServerActionsV293TestJSON-568249167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3fc7666dca14c5791054aa3cb89ebb3',uuid=eb1a22c1-175e-480f-9ddf-cd297df993c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Converting VIF {"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG nova.objects.instance [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lazy-loading 'pci_devices' on Instance uuid eb1a22c1-175e-480f-9ddf-cd297df993c8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:14:35 user nova-compute[72815]:   <uuid>eb1a22c1-175e-480f-9ddf-cd297df993c8</uuid>
Aug 17 20:14:35 user nova-compute[72815]:   <name>instance-0000002b</name>
Aug 17 20:14:35 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:14:35 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:14:35 user nova-compute[72815]:   <metadata>
Aug 17 20:14:35 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:14:35 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:14:35 user nova-compute[72815]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1306781066</nova:name>
Aug 17 20:14:35 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:14:33</nova:creationTime>
Aug 17 20:14:35 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:14:35 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:14:35 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:14:35 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:14:35 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:14:35 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:14:35 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:14:35 user nova-compute[72815]:       <nova:owner>
Aug 17 20:14:35 user nova-compute[72815]:         <nova:user uuid="c3fc7666dca14c5791054aa3cb89ebb3">tempest-ServerActionsV293TestJSON-568249167-project-member</nova:user>
Aug 17 20:14:35 user nova-compute[72815]:         <nova:project uuid="d85890dbab214814b52076eb232cac3f">tempest-ServerActionsV293TestJSON-568249167</nova:project>
Aug 17 20:14:35 user nova-compute[72815]:       </nova:owner>
Aug 17 20:14:35 user nova-compute[72815]:       <nova:ports>
Aug 17 20:14:35 user nova-compute[72815]:         <nova:port uuid="9d809bd7-984f-4bdd-8d4c-76fbe05ec68c">
Aug 17 20:14:35 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 20:14:35 user nova-compute[72815]:         </nova:port>
Aug 17 20:14:35 user nova-compute[72815]:       </nova:ports>
Aug 17 20:14:35 user nova-compute[72815]:     </nova:instance>
Aug 17 20:14:35 user nova-compute[72815]:   </metadata>
Aug 17 20:14:35 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:14:35 user nova-compute[72815]:     <system>
Aug 17 20:14:35 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:14:35 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:14:35 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:14:35 user nova-compute[72815]:       <entry name="serial">eb1a22c1-175e-480f-9ddf-cd297df993c8</entry>
Aug 17 20:14:35 user nova-compute[72815]:       <entry name="uuid">eb1a22c1-175e-480f-9ddf-cd297df993c8</entry>
Aug 17 20:14:35 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:14:35 user nova-compute[72815]:     </system>
Aug 17 20:14:35 user nova-compute[72815]:   </sysinfo>
Aug 17 20:14:35 user nova-compute[72815]:   <os>
Aug 17 20:14:35 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:14:35 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:14:35 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:14:35 user nova-compute[72815]:   </os>
Aug 17 20:14:35 user nova-compute[72815]:   <features>
Aug 17 20:14:35 user nova-compute[72815]:     <acpi/>
Aug 17 20:14:35 user nova-compute[72815]:     <apic/>
Aug 17 20:14:35 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:14:35 user nova-compute[72815]:   </features>
Aug 17 20:14:35 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:14:35 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:14:35 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:14:35 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:14:35 user nova-compute[72815]:   </clock>
Aug 17 20:14:35 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:14:35 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:14:35 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:14:35 user nova-compute[72815]:   </cpu>
Aug 17 20:14:35 user nova-compute[72815]:   <devices>
Aug 17 20:14:35 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:14:35 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:14:35 user nova-compute[72815]:       <source dev="/dev/sdb"/>
Aug 17 20:14:35 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:14:35 user nova-compute[72815]:       <serial>a87d5356-8d0f-4d8d-97c1-863f303090ea</serial>
Aug 17 20:14:35 user nova-compute[72815]:     </disk>
Aug 17 20:14:35 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:14:35 user nova-compute[72815]:       <mac address="fa:16:3e:2b:26:1f"/>
Aug 17 20:14:35 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:14:35 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:14:35 user nova-compute[72815]:       <target dev="tap9d809bd7-98"/>
Aug 17 20:14:35 user nova-compute[72815]:     </interface>
Aug 17 20:14:35 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:14:35 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/eb1a22c1-175e-480f-9ddf-cd297df993c8/console.log" append="off"/>
Aug 17 20:14:35 user nova-compute[72815]:     </serial>
Aug 17 20:14:35 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:14:35 user nova-compute[72815]:     <video>
Aug 17 20:14:35 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:14:35 user nova-compute[72815]:     </video>
Aug 17 20:14:35 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:14:35 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:14:35 user nova-compute[72815]:     </rng>
Aug 17 20:14:35 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:14:35 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:14:35 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:14:35 user nova-compute[72815]:     </memballoon>
Aug 17 20:14:35 user nova-compute[72815]:   </devices>
Aug 17 20:14:35 user nova-compute[72815]: </domain>
Aug 17 20:14:35 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1306781066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1306781066',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT7QCi8nId/iu4W4vvmCjsuZSx5jxi+6/A/TppcD7spua4Voq9EKV3Cbyn1NISMYCmgMHcmF2qyJPdVxn7gfwy+H7ZUMeDJ7/t4NxqxTvVHfq3jjyoTa4Leb+MiNll4+g==',key_name='tempest-keypair-1418290547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d85890dbab214814b52076eb232cac3f',ramdisk_id='',reservation_id='r-nkq44203',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-568249167',owner_user_name='tempest-ServerActionsV293TestJSON-568249167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3fc7666dca14c5791054aa3cb89ebb3',uuid=eb1a22c1-175e-480f-9ddf-cd297df993c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Converting VIF {"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG os_vif [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d809bd7-98, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d809bd7-98, col_values=(('external_ids', {'iface-id': '9d809bd7-984f-4bdd-8d4c-76fbe05ec68c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:26:1f', 'vm-uuid': 'eb1a22c1-175e-480f-9ddf-cd297df993c8'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:35 user nova-compute[72815]: INFO os_vif [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98')
Aug 17 20:14:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] No VIF found with MAC fa:16:3e:2b:26:1f, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:14:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:36 user nova-compute[72815]: DEBUG nova.compute.manager [req-9c671f18-c636-4b7c-81cc-e57d5454d432 req-4a0d1f68-81d4-4ee4-92ef-38fd770dc5df service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9c671f18-c636-4b7c-81cc-e57d5454d432 req-4a0d1f68-81d4-4ee4-92ef-38fd770dc5df service nova] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9c671f18-c636-4b7c-81cc-e57d5454d432 req-4a0d1f68-81d4-4ee4-92ef-38fd770dc5df service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9c671f18-c636-4b7c-81cc-e57d5454d432 req-4a0d1f68-81d4-4ee4-92ef-38fd770dc5df service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:36 user nova-compute[72815]: DEBUG nova.compute.manager [req-9c671f18-c636-4b7c-81cc-e57d5454d432 req-4a0d1f68-81d4-4ee4-92ef-38fd770dc5df service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] No waiting events found dispatching network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:14:36 user nova-compute[72815]: WARNING nova.compute.manager [req-9c671f18-c636-4b7c-81cc-e57d5454d432 req-4a0d1f68-81d4-4ee4-92ef-38fd770dc5df service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received unexpected event network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c for instance with vm_state building and task_state spawning.
Aug 17 20:14:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303278.8958168, eb1a22c1-175e-480f-9ddf-cd297df993c8 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:14:38 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] VM Resumed (Lifecycle Event)
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:14:38 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Instance spawned successfully.
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:14:38 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303278.9076812, eb1a22c1-175e-480f-9ddf-cd297df993c8 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:14:38 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] VM Started (Lifecycle Event)
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:14:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:14:39 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:14:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-1a7a6642-95e9-408c-b6b7-b5634687b195 req-2fadfe7b-68e1-411e-83e0-51f575cb9fe2 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1a7a6642-95e9-408c-b6b7-b5634687b195 req-2fadfe7b-68e1-411e-83e0-51f575cb9fe2 service nova] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1a7a6642-95e9-408c-b6b7-b5634687b195 req-2fadfe7b-68e1-411e-83e0-51f575cb9fe2 service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1a7a6642-95e9-408c-b6b7-b5634687b195 req-2fadfe7b-68e1-411e-83e0-51f575cb9fe2 service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG nova.compute.manager [req-1a7a6642-95e9-408c-b6b7-b5634687b195 req-2fadfe7b-68e1-411e-83e0-51f575cb9fe2 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] No waiting events found dispatching network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:14:39 user nova-compute[72815]: WARNING nova.compute.manager [req-1a7a6642-95e9-408c-b6b7-b5634687b195 req-2fadfe7b-68e1-411e-83e0-51f575cb9fe2 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received unexpected event network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c for instance with vm_state building and task_state spawning.
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:39 user nova-compute[72815]: INFO nova.compute.manager [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Took 5.12 seconds to spawn the instance on the hypervisor.
Aug 17 20:14:39 user nova-compute[72815]: DEBUG nova.compute.manager [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:14:39 user nova-compute[72815]: INFO nova.compute.manager [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Took 27.68 seconds to build instance.
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-9f9062d8-10f4-4e86-a670-e0deb5d7be3f tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.825s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:14:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:40 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:14:40 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:14:40 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:14:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7683MB free_disk=25.286590576171875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:14:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 8ac64ac9-a49d-4c70-956b-3a140da5ede8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 99693a7e-71e3-4543-b649-41a147c77c7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance e7e09061-f65f-444b-98f6-409da28295e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 0145191d-46b5-458c-9e04-136bd4635d40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 37ce6156-441f-4e86-89c1-9a3b1590df47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance eb1a22c1-175e-480f-9ddf-cd297df993c8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Refreshing inventories for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Updating ProviderTree inventory for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Updating inventory in ProviderTree for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Refreshing aggregate associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, aggregates: None {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Refreshing trait associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.743s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:14:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:14:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:14:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "e7e09061-f65f-444b-98f6-409da28295e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:43 user nova-compute[72815]: INFO nova.compute.manager [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Terminating instance
Aug 17 20:14:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:14:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:14:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:14:43 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:14:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-b2a96c3f-d7a4-4244-9b14-a64b4897df75 req-8086685e-98cb-4aa6-a059-65bcfe34aae3 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-unplugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b2a96c3f-d7a4-4244-9b14-a64b4897df75 req-8086685e-98cb-4aa6-a059-65bcfe34aae3 service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b2a96c3f-d7a4-4244-9b14-a64b4897df75 req-8086685e-98cb-4aa6-a059-65bcfe34aae3 service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b2a96c3f-d7a4-4244-9b14-a64b4897df75 req-8086685e-98cb-4aa6-a059-65bcfe34aae3 service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-b2a96c3f-d7a4-4244-9b14-a64b4897df75 req-8086685e-98cb-4aa6-a059-65bcfe34aae3 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-unplugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-b2a96c3f-d7a4-4244-9b14-a64b4897df75 req-8086685e-98cb-4aa6-a059-65bcfe34aae3 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-unplugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updating instance_info_cache with network_info: [{"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Instance destroyed successfully.
Aug 17 20:14:44 user nova-compute[72815]: DEBUG nova.objects.instance [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'resources' on Instance uuid e7e09061-f65f-444b-98f6-409da28295e2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2100679262',display_name='tempest-ServerRescueNegativeTestJSON-server-2100679262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2100679262',id=35,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQVuZd8HY1YPAnMPmmsKQMN4BVcIIqgoZWCg993IqB30y+h05kxKBZmQl9HxcfNKYfglRHgFsde7WW/VjaU0fJe/3jwAEIqfff8lEApN4BAQw9wX0KAw+Voy57bKwOKLg==',key_name='tempest-keypair-1902815982',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:10:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6d2cf2910f4d3d9924480d68057b5a',ramdisk_id='',reservation_id='r-g1lbtbjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-335799606',owner_user_name='tempest-ServerRescueNegativeTestJSON-335799606-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa27c69e40f243d9b38c87250b5dba5f',uuid=e7e09061-f65f-444b-98f6-409da28295e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converting VIF {"id": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "address": "fa:16:3e:c4:fd:56", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d3944-52", "ovs_interfaceid": "7a6d3944-52f6-4ffc-81d1-f648b2b44f59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:fd:56,bridge_name='br-int',has_traffic_filtering=True,id=7a6d3944-52f6-4ffc-81d1-f648b2b44f59,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d3944-52') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG os_vif [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:fd:56,bridge_name='br-int',has_traffic_filtering=True,id=7a6d3944-52f6-4ffc-81d1-f648b2b44f59,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d3944-52') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a6d3944-52, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: INFO os_vif [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:fd:56,bridge_name='br-int',has_traffic_filtering=True,id=7a6d3944-52f6-4ffc-81d1-f648b2b44f59,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d3944-52')
Aug 17 20:14:44 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Deleting instance files /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2_del
Aug 17 20:14:44 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Deletion of /opt/stack/data/nova/instances/e7e09061-f65f-444b-98f6-409da28295e2_del complete
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: INFO nova.compute.manager [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 17 20:14:44 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: e7e09061-f65f-444b-98f6-409da28295e2] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:45 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:14:45 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Took 1.04 seconds to deallocate network for instance.
Aug 17 20:14:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-7ee3cf04-88c8-4e07-92c8-c001ce0ea3d7 req-1ed24e2c-fbb8-4b9e-8868-76c529f4b1c0 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-deleted-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:45 user nova-compute[72815]: INFO nova.compute.manager [req-7ee3cf04-88c8-4e07-92c8-c001ce0ea3d7 req-1ed24e2c-fbb8-4b9e-8868-76c529f4b1c0 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Neutron deleted interface 7a6d3944-52f6-4ffc-81d1-f648b2b44f59; detaching it from the instance and deleting it from the info cache
Aug 17 20:14:45 user nova-compute[72815]: DEBUG nova.network.neutron [req-7ee3cf04-88c8-4e07-92c8-c001ce0ea3d7 req-1ed24e2c-fbb8-4b9e-8868-76c529f4b1c0 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:14:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-7ee3cf04-88c8-4e07-92c8-c001ce0ea3d7 req-1ed24e2c-fbb8-4b9e-8868-76c529f4b1c0 service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Detach interface failed, port_id=7a6d3944-52f6-4ffc-81d1-f648b2b44f59, reason: Instance e7e09061-f65f-444b-98f6-409da28295e2 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:14:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:46 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Deleted allocations for instance e7e09061-f65f-444b-98f6-409da28295e2
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:14:46 user nova-compute[72815]: WARNING nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state deleted and task_state None.
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:14:46 user nova-compute[72815]: WARNING nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state deleted and task_state None.
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:14:46 user nova-compute[72815]: WARNING nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state deleted and task_state None.
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-unplugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-unplugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:14:46 user nova-compute[72815]: WARNING nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-unplugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state deleted and task_state None.
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Acquiring lock "e7e09061-f65f-444b-98f6-409da28295e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] Lock "e7e09061-f65f-444b-98f6-409da28295e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] No waiting events found dispatching network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:14:46 user nova-compute[72815]: WARNING nova.compute.manager [req-3c8fda64-a7cd-449c-9a29-491c4a3319c0 req-48b28162-058b-420f-8628-01d4c7329f3e service nova] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Received unexpected event network-vif-plugged-7a6d3944-52f6-4ffc-81d1-f648b2b44f59 for instance with vm_state deleted and task_state None.
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1b1694df-1239-4c8f-9e28-017382076c31 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "e7e09061-f65f-444b-98f6-409da28295e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.513s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:14:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 20:14:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:14:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 20:14:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] There are 0 instances to clean {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 20:14:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:14:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:14:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:14:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:14:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:14:59 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303284.492732, e7e09061-f65f-444b-98f6-409da28295e2 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:14:59 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: e7e09061-f65f-444b-98f6-409da28295e2] VM Stopped (Lifecycle Event)
Aug 17 20:14:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ef64d589-8969-4ccc-9889-2fc6c20d15e6 None None] [instance: e7e09061-f65f-444b-98f6-409da28295e2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:14:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:15:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:01 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:15:01 user nova-compute[72815]: INFO nova.compute.claims [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Claim successful on node user
Aug 17 20:15:01 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:15:01 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:02 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:15:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:15:02 user nova-compute[72815]: INFO nova.virt.block_device [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Booting with volume 6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 at /dev/vda
Aug 17 20:15:02 user nova-compute[72815]: DEBUG nova.policy [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '577ed0692a254a2fbd518e258563447f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78ad2cbee8e4db892ab66d619e0e42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG os_brick.utils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cace610-198d-4c42-91c5-8a8a5b901e37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3153b0-71b0-4dd0-9994-be517b88538f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[11283435-dc51-47f8-afb6-e4d7647e0490]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1bf21f-9acd-4a08-ab00-0e6b6ec40a11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:15:02 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:15:02 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce264ba-4afd-4dec-8029-e80a27a762ec]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG os_brick.utils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Updating existing volume attachment record: f1eb05f1-677f-4b30-bdc0-70b1b8f9e50a {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:15:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Successfully created port: 9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:15:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Successfully updated port: 9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:15:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "refresh_cache-c3a35887-4756-41ee-ba99-5b4e9fef7a80" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:15:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquired lock "refresh_cache-c3a35887-4756-41ee-ba99-5b4e9fef7a80" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:15:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:15:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-cc46179f-6f32-42ed-be97-1a561e71a9c0 req-9d9e480d-7578-45ce-8d39-19679d80a294 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Received event network-changed-9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-cc46179f-6f32-42ed-be97-1a561e71a9c0 req-9d9e480d-7578-45ce-8d39-19679d80a294 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Refreshing instance network info cache due to event network-changed-9994e51b-d64f-4b64-8d37-421d34ee3b8e. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:15:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cc46179f-6f32-42ed-be97-1a561e71a9c0 req-9d9e480d-7578-45ce-8d39-19679d80a294 service nova] Acquiring lock "refresh_cache-c3a35887-4756-41ee-ba99-5b4e9fef7a80" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:15:03 user nova-compute[72815]: DEBUG nova.network.neutron [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:15:04 user nova-compute[72815]: DEBUG nova.network.neutron [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Updating instance_info_cache with network_info: [{"id": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "address": "fa:16:3e:e4:f2:17", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9994e51b-d6", "ovs_interfaceid": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:15:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Releasing lock "refresh_cache-c3a35887-4756-41ee-ba99-5b4e9fef7a80" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:15:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Instance network_info: |[{"id": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "address": "fa:16:3e:e4:f2:17", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9994e51b-d6", "ovs_interfaceid": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:15:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cc46179f-6f32-42ed-be97-1a561e71a9c0 req-9d9e480d-7578-45ce-8d39-19679d80a294 service nova] Acquired lock "refresh_cache-c3a35887-4756-41ee-ba99-5b4e9fef7a80" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:15:04 user nova-compute[72815]: DEBUG nova.network.neutron [req-cc46179f-6f32-42ed-be97-1a561e71a9c0 req-9d9e480d-7578-45ce-8d39-19679d80a294 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Refreshing network info cache for port 9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:15:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:04 user nova-compute[72815]: DEBUG nova.network.neutron [req-cc46179f-6f32-42ed-be97-1a561e71a9c0 req-9d9e480d-7578-45ce-8d39-19679d80a294 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Updated VIF entry in instance network info cache for port 9994e51b-d64f-4b64-8d37-421d34ee3b8e. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:15:04 user nova-compute[72815]: DEBUG nova.network.neutron [req-cc46179f-6f32-42ed-be97-1a561e71a9c0 req-9d9e480d-7578-45ce-8d39-19679d80a294 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Updating instance_info_cache with network_info: [{"id": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "address": "fa:16:3e:e4:f2:17", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9994e51b-d6", "ovs_interfaceid": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:15:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-cc46179f-6f32-42ed-be97-1a561e71a9c0 req-9d9e480d-7578-45ce-8d39-19679d80a294 service nova] Releasing lock "refresh_cache-c3a35887-4756-41ee-ba99-5b4e9fef7a80" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:15:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:15:13 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Creating image(s)
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Ensure instance console log exists: /opt/stack/data/nova/instances/c3a35887-4756-41ee-ba99-5b4e9fef7a80/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Start _get_guest_xml network_info=[{"id": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "address": "fa:16:3e:e4:f2:17", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9994e51b-d6", "ovs_interfaceid": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': 'f1eb05f1-677f-4b30-bdc0-70b1b8f9e50a', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yivEHohA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3a35887-4756-41ee-ba99-5b4e9fef7a80', 'attached_at': '', 'detached_at': '', 'volume_id': '6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27', 'serial': '6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:15:13 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:15:13 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yivEHohA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:15:13 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:15:13 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:15:13 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[173ade4d-9b84-4b9e-8735-0884dea1a2fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:15:13 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b921e42-36be-4ab9-9d82-677a95072149]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27] added
Aug 17 20:15:13 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccae0ba-f5eb-4d67-b637-1e64ea6fc157]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca67c63-b0b0-4c75-87b9-1b33e2dcac53]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yivEHohA {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yivEHohA" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[205eb97a-ce5c-40a6-9cb0-69aafb5db3f7]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yivEHohA'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c519f6-d6aa-49b5-b786-3127301e022e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a93339-814e-423f-bdfb-714e98ccec79]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:13 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:13 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d82000-48b4-4560-bfda-6ac2e6056683]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260]
Aug 17 20:15:13 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260] successful.
Aug 17 20:15:13 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf825da3-4396-4a37-bacb-7332c95e44e4]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a00467f-3455-462f-8cf4-718b011b993a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:13 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:15:13 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:13 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:15:13 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e69686-ad2e-49d3-b0aa-aa6a2e5aa87e]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:13 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yivEHohA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23966353663663731', 'path': '/dev/sdc'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966353663663731', 'path': '/dev/sdc'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-420576860',display_name='tempest-TestVolumeBootPattern-server-420576860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-420576860',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpfGoBrYuqmPWFRwR9dBH3etfjmi+9O1crWczyHc9MI1VhAR15OT7t+WrT1HrpsEV9/2nWGMdeUlL2wsj6uonqU5hD2QzwNh0c4wK0+zMM0byFWbIkK5vSFxWEBfwR78Q==',key_name='tempest-TestVolumeBootPattern-525261020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-coobtyij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:15:02Z,user_data=None,user_id='577ed0692a254a2fbd518e258563447f',uuid=c3a35887-4756-41ee-ba99-5b4e9fef7a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "address": "fa:16:3e:e4:f2:17", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9994e51b-d6", "ovs_interfaceid": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "address": "fa:16:3e:e4:f2:17", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9994e51b-d6", "ovs_interfaceid": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f2:17,bridge_name='br-int',has_traffic_filtering=True,id=9994e51b-d64f-4b64-8d37-421d34ee3b8e,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9994e51b-d6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG nova.objects.instance [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lazy-loading 'pci_devices' on Instance uuid c3a35887-4756-41ee-ba99-5b4e9fef7a80 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:15:14 user nova-compute[72815]:   <uuid>c3a35887-4756-41ee-ba99-5b4e9fef7a80</uuid>
Aug 17 20:15:14 user nova-compute[72815]:   <name>instance-0000002c</name>
Aug 17 20:15:14 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:15:14 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:15:14 user nova-compute[72815]:   <metadata>
Aug 17 20:15:14 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:15:14 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:15:14 user nova-compute[72815]:       <nova:name>tempest-TestVolumeBootPattern-server-420576860</nova:name>
Aug 17 20:15:14 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:15:13</nova:creationTime>
Aug 17 20:15:14 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:15:14 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:15:14 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:15:14 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:15:14 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:15:14 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:15:14 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:15:14 user nova-compute[72815]:       <nova:owner>
Aug 17 20:15:14 user nova-compute[72815]:         <nova:user uuid="577ed0692a254a2fbd518e258563447f">tempest-TestVolumeBootPattern-781314261-project-member</nova:user>
Aug 17 20:15:14 user nova-compute[72815]:         <nova:project uuid="a78ad2cbee8e4db892ab66d619e0e42e">tempest-TestVolumeBootPattern-781314261</nova:project>
Aug 17 20:15:14 user nova-compute[72815]:       </nova:owner>
Aug 17 20:15:14 user nova-compute[72815]:       <nova:ports>
Aug 17 20:15:14 user nova-compute[72815]:         <nova:port uuid="9994e51b-d64f-4b64-8d37-421d34ee3b8e">
Aug 17 20:15:14 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 20:15:14 user nova-compute[72815]:         </nova:port>
Aug 17 20:15:14 user nova-compute[72815]:       </nova:ports>
Aug 17 20:15:14 user nova-compute[72815]:     </nova:instance>
Aug 17 20:15:14 user nova-compute[72815]:   </metadata>
Aug 17 20:15:14 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:15:14 user nova-compute[72815]:     <system>
Aug 17 20:15:14 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:15:14 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:15:14 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:15:14 user nova-compute[72815]:       <entry name="serial">c3a35887-4756-41ee-ba99-5b4e9fef7a80</entry>
Aug 17 20:15:14 user nova-compute[72815]:       <entry name="uuid">c3a35887-4756-41ee-ba99-5b4e9fef7a80</entry>
Aug 17 20:15:14 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:15:14 user nova-compute[72815]:     </system>
Aug 17 20:15:14 user nova-compute[72815]:   </sysinfo>
Aug 17 20:15:14 user nova-compute[72815]:   <os>
Aug 17 20:15:14 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:15:14 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:15:14 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:15:14 user nova-compute[72815]:   </os>
Aug 17 20:15:14 user nova-compute[72815]:   <features>
Aug 17 20:15:14 user nova-compute[72815]:     <acpi/>
Aug 17 20:15:14 user nova-compute[72815]:     <apic/>
Aug 17 20:15:14 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:15:14 user nova-compute[72815]:   </features>
Aug 17 20:15:14 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:15:14 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:15:14 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:15:14 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:15:14 user nova-compute[72815]:   </clock>
Aug 17 20:15:14 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:15:14 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:15:14 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:15:14 user nova-compute[72815]:   </cpu>
Aug 17 20:15:14 user nova-compute[72815]:   <devices>
Aug 17 20:15:14 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:15:14 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:15:14 user nova-compute[72815]:       <source dev="/dev/sdc"/>
Aug 17 20:15:14 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:15:14 user nova-compute[72815]:       <serial>6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27</serial>
Aug 17 20:15:14 user nova-compute[72815]:     </disk>
Aug 17 20:15:14 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:15:14 user nova-compute[72815]:       <mac address="fa:16:3e:e4:f2:17"/>
Aug 17 20:15:14 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:15:14 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:15:14 user nova-compute[72815]:       <target dev="tap9994e51b-d6"/>
Aug 17 20:15:14 user nova-compute[72815]:     </interface>
Aug 17 20:15:14 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:15:14 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/c3a35887-4756-41ee-ba99-5b4e9fef7a80/console.log" append="off"/>
Aug 17 20:15:14 user nova-compute[72815]:     </serial>
Aug 17 20:15:14 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:15:14 user nova-compute[72815]:     <video>
Aug 17 20:15:14 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:15:14 user nova-compute[72815]:     </video>
Aug 17 20:15:14 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:15:14 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:15:14 user nova-compute[72815]:     </rng>
Aug 17 20:15:14 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:15:14 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:15:14 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:15:14 user nova-compute[72815]:     </memballoon>
Aug 17 20:15:14 user nova-compute[72815]:   </devices>
Aug 17 20:15:14 user nova-compute[72815]: </domain>
Aug 17 20:15:14 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-420576860',display_name='tempest-TestVolumeBootPattern-server-420576860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-420576860',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpfGoBrYuqmPWFRwR9dBH3etfjmi+9O1crWczyHc9MI1VhAR15OT7t+WrT1HrpsEV9/2nWGMdeUlL2wsj6uonqU5hD2QzwNh0c4wK0+zMM0byFWbIkK5vSFxWEBfwR78Q==',key_name='tempest-TestVolumeBootPattern-525261020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-coobtyij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:15:02Z,user_data=None,user_id='577ed0692a254a2fbd518e258563447f',uuid=c3a35887-4756-41ee-ba99-5b4e9fef7a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "address": "fa:16:3e:e4:f2:17", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9994e51b-d6", "ovs_interfaceid": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "address": "fa:16:3e:e4:f2:17", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9994e51b-d6", "ovs_interfaceid": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f2:17,bridge_name='br-int',has_traffic_filtering=True,id=9994e51b-d64f-4b64-8d37-421d34ee3b8e,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9994e51b-d6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG os_vif [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f2:17,bridge_name='br-int',has_traffic_filtering=True,id=9994e51b-d64f-4b64-8d37-421d34ee3b8e,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9994e51b-d6') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9994e51b-d6, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9994e51b-d6, col_values=(('external_ids', {'iface-id': '9994e51b-d64f-4b64-8d37-421d34ee3b8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:f2:17', 'vm-uuid': 'c3a35887-4756-41ee-ba99-5b4e9fef7a80'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:14 user nova-compute[72815]: INFO os_vif [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f2:17,bridge_name='br-int',has_traffic_filtering=True,id=9994e51b-d64f-4b64-8d37-421d34ee3b8e,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9994e51b-d6')
Aug 17 20:15:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:15:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] No VIF found with MAC fa:16:3e:e4:f2:17, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:15:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:16 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-f3f2802a-179d-45de-affc-902fd00d7195 req-c78f417c-a008-4696-ad0f-7261b11049a0 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Received event network-vif-plugged-9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f3f2802a-179d-45de-affc-902fd00d7195 req-c78f417c-a008-4696-ad0f-7261b11049a0 service nova] Acquiring lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f3f2802a-179d-45de-affc-902fd00d7195 req-c78f417c-a008-4696-ad0f-7261b11049a0 service nova] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f3f2802a-179d-45de-affc-902fd00d7195 req-c78f417c-a008-4696-ad0f-7261b11049a0 service nova] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:16 user nova-compute[72815]: DEBUG nova.compute.manager [req-f3f2802a-179d-45de-affc-902fd00d7195 req-c78f417c-a008-4696-ad0f-7261b11049a0 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] No waiting events found dispatching network-vif-plugged-9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:15:16 user nova-compute[72815]: WARNING nova.compute.manager [req-f3f2802a-179d-45de-affc-902fd00d7195 req-c78f417c-a008-4696-ad0f-7261b11049a0 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Received unexpected event network-vif-plugged-9994e51b-d64f-4b64-8d37-421d34ee3b8e for instance with vm_state building and task_state spawning.
Aug 17 20:15:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'flavor' on Instance uuid 0145191d-46b5-458c-9e04-136bd4635d40 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:17 user nova-compute[72815]: INFO nova.compute.manager [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Attaching volume a479307e-e873-4e7a-bde9-d2d235f6201d to /dev/vdb
Aug 17 20:15:17 user nova-compute[72815]: DEBUG os_brick.utils [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cf6f5d-0719-4eed-947d-d10a3a7b28c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[99917ccd-6939-4d42-811a-6ee3e91bd9a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[38428067-c8e7-4d79-ac68-2d448172dc5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[75004fad-00ef-406d-b0de-d57380b879aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:17 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:15:18 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b88718-cd99-4822-ad7a-38befd7f7be0]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG os_brick.utils [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updating existing volume attachment record: 5850f351-7b2d-4192-8dcb-6923c0091ae2 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303318.3803759, c3a35887-4756-41ee-ba99-5b4e9fef7a80 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:15:18 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] VM Resumed (Lifecycle Event)
Aug 17 20:15:18 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Instance spawned successfully.
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:15:18 user nova-compute[72815]: INFO nova.compute.claims [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Claim successful on node user
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:15:18 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303318.384723, c3a35887-4756-41ee-ba99-5b4e9fef7a80 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:15:18 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] VM Started (Lifecycle Event)
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:15:18 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:15:18 user nova-compute[72815]: INFO nova.compute.manager [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Took 5.24 seconds to spawn the instance on the hypervisor.
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:15:18 user nova-compute[72815]: INFO nova.compute.manager [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Took 17.02 seconds to build instance.
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-1ff789e3-5dd1-48c0-b14d-1e4b0a089154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.212s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c70d18b-ca35-491c-8bab-08c86a786a65 req-30b9c617-c698-44ae-98aa-e5f919fd9e61 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Received event network-vif-plugged-9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c70d18b-ca35-491c-8bab-08c86a786a65 req-30b9c617-c698-44ae-98aa-e5f919fd9e61 service nova] Acquiring lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c70d18b-ca35-491c-8bab-08c86a786a65 req-30b9c617-c698-44ae-98aa-e5f919fd9e61 service nova] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c70d18b-ca35-491c-8bab-08c86a786a65 req-30b9c617-c698-44ae-98aa-e5f919fd9e61 service nova] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c70d18b-ca35-491c-8bab-08c86a786a65 req-30b9c617-c698-44ae-98aa-e5f919fd9e61 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] No waiting events found dispatching network-vif-plugged-9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:15:18 user nova-compute[72815]: WARNING nova.compute.manager [req-3c70d18b-ca35-491c-8bab-08c86a786a65 req-30b9c617-c698-44ae-98aa-e5f919fd9e61 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Received unexpected event network-vif-plugged-9994e51b-d64f-4b64-8d37-421d34ee3b8e for instance with vm_state active and task_state None.
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:15:18 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:15:19 user nova-compute[72815]: DEBUG nova.policy [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b344ee6f91744dd79f8a884a9212da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d837d09a38d4d97a262d1ca77c00134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:15:19 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:15:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:15:19 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:15:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:15:19 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Creating image(s)
Aug 17 20:15:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "/opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "/opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "/opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.248s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:19 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.288s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk 1073741824" returned: 0 in 0.058s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Successfully created port: 5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.243s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Cannot resize image /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG nova.objects.instance [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lazy-loading 'migration_context' on Instance uuid 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Ensure instance console log exists: /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:21 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Successfully updated port: 5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:15:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "refresh_cache-11d388da-9c0f-4ccf-8307-0cb7e1679fd2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:15:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquired lock "refresh_cache-11d388da-9c0f-4ccf-8307-0cb7e1679fd2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:15:21 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:15:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-9d3d0fbd-068b-459f-bab9-7aaa400ae066 req-9cd935cc-aa5d-49f2-b8f6-1c7969d70cfa service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Received event network-changed-5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-9d3d0fbd-068b-459f-bab9-7aaa400ae066 req-9cd935cc-aa5d-49f2-b8f6-1c7969d70cfa service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Refreshing instance network info cache due to event network-changed-5eedb847-6aab-4b85-9e46-3ec250d0499c. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:15:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9d3d0fbd-068b-459f-bab9-7aaa400ae066 req-9cd935cc-aa5d-49f2-b8f6-1c7969d70cfa service nova] Acquiring lock "refresh_cache-11d388da-9c0f-4ccf-8307-0cb7e1679fd2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:15:21 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.network.neutron [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Updating instance_info_cache with network_info: [{"id": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "address": "fa:16:3e:f0:81:a4", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eedb847-6a", "ovs_interfaceid": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Releasing lock "refresh_cache-11d388da-9c0f-4ccf-8307-0cb7e1679fd2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Instance network_info: |[{"id": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "address": "fa:16:3e:f0:81:a4", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eedb847-6a", "ovs_interfaceid": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9d3d0fbd-068b-459f-bab9-7aaa400ae066 req-9cd935cc-aa5d-49f2-b8f6-1c7969d70cfa service nova] Acquired lock "refresh_cache-11d388da-9c0f-4ccf-8307-0cb7e1679fd2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.network.neutron [req-9d3d0fbd-068b-459f-bab9-7aaa400ae066 req-9cd935cc-aa5d-49f2-b8f6-1c7969d70cfa service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Refreshing network info cache for port 5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Start _get_guest_xml network_info=[{"id": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "address": "fa:16:3e:f0:81:a4", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eedb847-6a", "ovs_interfaceid": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:15:22 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:15:22 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-970272825',display_name='tempest-VolumesSnapshotTestJSON-instance-970272825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-970272825',id=45,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgELU1SmOLAiL9HkHASCtIPhS3ju2VFYC6EcMnX8HpKIw9sOVaB7FXkdB73ATq9AQ5qNIlV1aFb/aTUZDWo4AokBRB+bWr91nrOyotblgv3caD8ra7I9MVKzrz5QsFgBA==',key_name='tempest-keypair-1669905795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d837d09a38d4d97a262d1ca77c00134',ramdisk_id='',reservation_id='r-1cp72wsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-30442452',owner_user_name='tempest-VolumesSnapshotTestJSON-30442452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b344ee6f91744dd79f8a884a9212da6b',uuid=11d388da-9c0f-4ccf-8307-0cb7e1679fd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "address": "fa:16:3e:f0:81:a4", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eedb847-6a", "ovs_interfaceid": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Converting VIF {"id": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "address": "fa:16:3e:f0:81:a4", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eedb847-6a", "ovs_interfaceid": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:81:a4,bridge_name='br-int',has_traffic_filtering=True,id=5eedb847-6aab-4b85-9e46-3ec250d0499c,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eedb847-6a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.objects.instance [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lazy-loading 'pci_devices' on Instance uuid 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:15:22 user nova-compute[72815]:   <uuid>11d388da-9c0f-4ccf-8307-0cb7e1679fd2</uuid>
Aug 17 20:15:22 user nova-compute[72815]:   <name>instance-0000002d</name>
Aug 17 20:15:22 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:15:22 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:15:22 user nova-compute[72815]:   <metadata>
Aug 17 20:15:22 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:15:22 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:15:22 user nova-compute[72815]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-970272825</nova:name>
Aug 17 20:15:22 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:15:22</nova:creationTime>
Aug 17 20:15:22 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:15:22 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:15:22 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:15:22 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:15:22 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:15:22 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:15:22 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:15:22 user nova-compute[72815]:       <nova:owner>
Aug 17 20:15:22 user nova-compute[72815]:         <nova:user uuid="b344ee6f91744dd79f8a884a9212da6b">tempest-VolumesSnapshotTestJSON-30442452-project-member</nova:user>
Aug 17 20:15:22 user nova-compute[72815]:         <nova:project uuid="2d837d09a38d4d97a262d1ca77c00134">tempest-VolumesSnapshotTestJSON-30442452</nova:project>
Aug 17 20:15:22 user nova-compute[72815]:       </nova:owner>
Aug 17 20:15:22 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:15:22 user nova-compute[72815]:       <nova:ports>
Aug 17 20:15:22 user nova-compute[72815]:         <nova:port uuid="5eedb847-6aab-4b85-9e46-3ec250d0499c">
Aug 17 20:15:22 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 20:15:22 user nova-compute[72815]:         </nova:port>
Aug 17 20:15:22 user nova-compute[72815]:       </nova:ports>
Aug 17 20:15:22 user nova-compute[72815]:     </nova:instance>
Aug 17 20:15:22 user nova-compute[72815]:   </metadata>
Aug 17 20:15:22 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:15:22 user nova-compute[72815]:     <system>
Aug 17 20:15:22 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:15:22 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:15:22 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:15:22 user nova-compute[72815]:       <entry name="serial">11d388da-9c0f-4ccf-8307-0cb7e1679fd2</entry>
Aug 17 20:15:22 user nova-compute[72815]:       <entry name="uuid">11d388da-9c0f-4ccf-8307-0cb7e1679fd2</entry>
Aug 17 20:15:22 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:15:22 user nova-compute[72815]:     </system>
Aug 17 20:15:22 user nova-compute[72815]:   </sysinfo>
Aug 17 20:15:22 user nova-compute[72815]:   <os>
Aug 17 20:15:22 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:15:22 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:15:22 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:15:22 user nova-compute[72815]:   </os>
Aug 17 20:15:22 user nova-compute[72815]:   <features>
Aug 17 20:15:22 user nova-compute[72815]:     <acpi/>
Aug 17 20:15:22 user nova-compute[72815]:     <apic/>
Aug 17 20:15:22 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:15:22 user nova-compute[72815]:   </features>
Aug 17 20:15:22 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:15:22 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:15:22 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:15:22 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:15:22 user nova-compute[72815]:   </clock>
Aug 17 20:15:22 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:15:22 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:15:22 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:15:22 user nova-compute[72815]:   </cpu>
Aug 17 20:15:22 user nova-compute[72815]:   <devices>
Aug 17 20:15:22 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:15:22 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:15:22 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk"/>
Aug 17 20:15:22 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:15:22 user nova-compute[72815]:     </disk>
Aug 17 20:15:22 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:15:22 user nova-compute[72815]:       <mac address="fa:16:3e:f0:81:a4"/>
Aug 17 20:15:22 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:15:22 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:15:22 user nova-compute[72815]:       <target dev="tap5eedb847-6a"/>
Aug 17 20:15:22 user nova-compute[72815]:     </interface>
Aug 17 20:15:22 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:15:22 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/console.log" append="off"/>
Aug 17 20:15:22 user nova-compute[72815]:     </serial>
Aug 17 20:15:22 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:15:22 user nova-compute[72815]:     <video>
Aug 17 20:15:22 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:15:22 user nova-compute[72815]:     </video>
Aug 17 20:15:22 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:15:22 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:15:22 user nova-compute[72815]:     </rng>
Aug 17 20:15:22 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:15:22 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:15:22 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:15:22 user nova-compute[72815]:     </memballoon>
Aug 17 20:15:22 user nova-compute[72815]:   </devices>
Aug 17 20:15:22 user nova-compute[72815]: </domain>
Aug 17 20:15:22 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-970272825',display_name='tempest-VolumesSnapshotTestJSON-instance-970272825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-970272825',id=45,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgELU1SmOLAiL9HkHASCtIPhS3ju2VFYC6EcMnX8HpKIw9sOVaB7FXkdB73ATq9AQ5qNIlV1aFb/aTUZDWo4AokBRB+bWr91nrOyotblgv3caD8ra7I9MVKzrz5QsFgBA==',key_name='tempest-keypair-1669905795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d837d09a38d4d97a262d1ca77c00134',ramdisk_id='',reservation_id='r-1cp72wsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-30442452',owner_user_name='tempest-VolumesSnapshotTestJSON-30442452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b344ee6f91744dd79f8a884a9212da6b',uuid=11d388da-9c0f-4ccf-8307-0cb7e1679fd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "address": "fa:16:3e:f0:81:a4", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eedb847-6a", "ovs_interfaceid": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Converting VIF {"id": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "address": "fa:16:3e:f0:81:a4", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eedb847-6a", "ovs_interfaceid": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:81:a4,bridge_name='br-int',has_traffic_filtering=True,id=5eedb847-6aab-4b85-9e46-3ec250d0499c,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eedb847-6a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG os_vif [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:81:a4,bridge_name='br-int',has_traffic_filtering=True,id=5eedb847-6aab-4b85-9e46-3ec250d0499c,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eedb847-6a') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5eedb847-6a, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5eedb847-6a, col_values=(('external_ids', {'iface-id': '5eedb847-6aab-4b85-9e46-3ec250d0499c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:81:a4', 'vm-uuid': '11d388da-9c0f-4ccf-8307-0cb7e1679fd2'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:22 user nova-compute[72815]: INFO os_vif [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:81:a4,bridge_name='br-int',has_traffic_filtering=True,id=5eedb847-6aab-4b85-9e46-3ec250d0499c,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eedb847-6a')
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] No VIF found with MAC fa:16:3e:f0:81:a4, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.network.neutron [req-9d3d0fbd-068b-459f-bab9-7aaa400ae066 req-9cd935cc-aa5d-49f2-b8f6-1c7969d70cfa service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Updated VIF entry in instance network info cache for port 5eedb847-6aab-4b85-9e46-3ec250d0499c. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG nova.network.neutron [req-9d3d0fbd-068b-459f-bab9-7aaa400ae066 req-9cd935cc-aa5d-49f2-b8f6-1c7969d70cfa service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Updating instance_info_cache with network_info: [{"id": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "address": "fa:16:3e:f0:81:a4", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eedb847-6a", "ovs_interfaceid": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:15:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9d3d0fbd-068b-459f-bab9-7aaa400ae066 req-9cd935cc-aa5d-49f2-b8f6-1c7969d70cfa service nova] Releasing lock "refresh_cache-11d388da-9c0f-4ccf-8307-0cb7e1679fd2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:15:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:24 user nova-compute[72815]: DEBUG nova.compute.manager [req-3470557e-4fad-4d31-95e4-fda2ff18d84c req-756ef2e3-0329-4d85-b89f-dd3e90d15149 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Received event network-vif-plugged-5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3470557e-4fad-4d31-95e4-fda2ff18d84c req-756ef2e3-0329-4d85-b89f-dd3e90d15149 service nova] Acquiring lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3470557e-4fad-4d31-95e4-fda2ff18d84c req-756ef2e3-0329-4d85-b89f-dd3e90d15149 service nova] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:24 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3470557e-4fad-4d31-95e4-fda2ff18d84c req-756ef2e3-0329-4d85-b89f-dd3e90d15149 service nova] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:24 user nova-compute[72815]: DEBUG nova.compute.manager [req-3470557e-4fad-4d31-95e4-fda2ff18d84c req-756ef2e3-0329-4d85-b89f-dd3e90d15149 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] No waiting events found dispatching network-vif-plugged-5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:15:24 user nova-compute[72815]: WARNING nova.compute.manager [req-3470557e-4fad-4d31-95e4-fda2ff18d84c req-756ef2e3-0329-4d85-b89f-dd3e90d15149 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Received unexpected event network-vif-plugged-5eedb847-6aab-4b85-9e46-3ec250d0499c for instance with vm_state building and task_state spawning.
Aug 17 20:15:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-302893d0-82ab-4aed-a771-2bcad14e28c0 req-cbc8e9ee-7bcb-423e-beed-cf30d8b26119 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Received event network-vif-plugged-5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-302893d0-82ab-4aed-a771-2bcad14e28c0 req-cbc8e9ee-7bcb-423e-beed-cf30d8b26119 service nova] Acquiring lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-302893d0-82ab-4aed-a771-2bcad14e28c0 req-cbc8e9ee-7bcb-423e-beed-cf30d8b26119 service nova] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-302893d0-82ab-4aed-a771-2bcad14e28c0 req-cbc8e9ee-7bcb-423e-beed-cf30d8b26119 service nova] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.compute.manager [req-302893d0-82ab-4aed-a771-2bcad14e28c0 req-cbc8e9ee-7bcb-423e-beed-cf30d8b26119 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] No waiting events found dispatching network-vif-plugged-5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:15:26 user nova-compute[72815]: WARNING nova.compute.manager [req-302893d0-82ab-4aed-a771-2bcad14e28c0 req-cbc8e9ee-7bcb-423e-beed-cf30d8b26119 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Received unexpected event network-vif-plugged-5eedb847-6aab-4b85-9e46-3ec250d0499c for instance with vm_state building and task_state spawning.
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303326.3907344, 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:15:26 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] VM Resumed (Lifecycle Event)
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:15:26 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Instance spawned successfully.
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:15:26 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303326.3949916, 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:15:26 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] VM Started (Lifecycle Event)
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:15:26 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:15:26 user nova-compute[72815]: INFO nova.compute.manager [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Took 7.00 seconds to spawn the instance on the hypervisor.
Aug 17 20:15:26 user nova-compute[72815]: DEBUG nova.compute.manager [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:15:26 user nova-compute[72815]: INFO nova.compute.manager [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Took 8.27 seconds to build instance.
Aug 17 20:15:26 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-e8f45bc6-7e5b-43be-aaa2-aaa9d99f4e21 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.361s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLMCXWtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:15:30 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:15:30 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:15:30 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ee8d98-1224-4e01-a1b5-0df6eeb29bc6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:15:30 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c15878-a333-45d9-a274-b1f630336214]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d] added
Aug 17 20:15:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[535f54a2-bfc7-47d5-80e9-c0a85ad857a0]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4245b183-bfc0-49ea-897b-962fa35318b1]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLMCXWtr {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLMCXWtr" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfbca98-c6cb-483c-8a87-0c2dd3f038c5]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZLMCXWtr'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb8eb35-d74b-476f-a025-8cd4a7c04c78]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f056c-a55a-4de7-b532-987e3ccce9b5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:30 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:15:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:30 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:15:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05d0730-13c2-4635-ac9a-4a23fc0f55ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260]
Aug 17 20:15:30 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260] successful.
Aug 17 20:15:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73e75ea-0a0d-400c-afa6-5ab82ad17b88]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb104cb3-9ee0-439d-a8ad-a2fc999c90fd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:30 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:15:30 user nova-compute[72815]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:15:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:30 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:15:30 user nova-compute[72815]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:15:30 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a022ca-4c0f-45e1-b3e1-255fe8c35c6e]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:30 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:15:31 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:15:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLMCXWtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:15:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:15:31 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23932633239306333', 'path': '/dev/sdd'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:15:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932633239306333', 'path': '/dev/sdd'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:15:31 user nova-compute[72815]: DEBUG nova.objects.instance [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'flavor' on Instance uuid 0145191d-46b5-458c-9e04-136bd4635d40 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:15:31 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:15:31 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:15:31 user nova-compute[72815]:   <source dev="/dev/sdd"/>
Aug 17 20:15:31 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:15:31 user nova-compute[72815]:   <serial>a479307e-e873-4e7a-bde9-d2d235f6201d</serial>
Aug 17 20:15:31 user nova-compute[72815]: </disk>
Aug 17 20:15:31 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:15:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:15:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:15:32 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] No VIF found with MAC fa:16:3e:fa:90:a8, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:15:32 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-2012c2a3-aa5e-46e2-9e4f-dc97143235ac tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.345s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:15:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:15:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:15:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:15:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:15:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:15:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:40 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:15:40 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7413MB free_disk=25.298904418945312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance ec0afde2-8d2b-451a-a226-be933e28ad6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 8ac64ac9-a49d-4c70-956b-3a140da5ede8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 99693a7e-71e3-4543-b649-41a147c77c7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 0145191d-46b5-458c-9e04-136bd4635d40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 37ce6156-441f-4e86-89c1-9a3b1590df47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance eb1a22c1-175e-480f-9ddf-cd297df993c8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance c3a35887-4756-41ee-ba99-5b4e9fef7a80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:15:40 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:15:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:15:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.776s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:15:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:15:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:15:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 20:15:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:15:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:15:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:15:44 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:15:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-e55a3722-621b-4482-bc0b-f148fcd5e548 req-493aff50-72b0-4725-8a1f-7dfb4f8ee618 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-changed-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-e55a3722-621b-4482-bc0b-f148fcd5e548 req-493aff50-72b0-4725-8a1f-7dfb4f8ee618 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Refreshing instance network info cache due to event network-changed-331a772e-61c5-4bbe-920e-f37642d7e012. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:15:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e55a3722-621b-4482-bc0b-f148fcd5e548 req-493aff50-72b0-4725-8a1f-7dfb4f8ee618 service nova] Acquiring lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:15:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e55a3722-621b-4482-bc0b-f148fcd5e548 req-493aff50-72b0-4725-8a1f-7dfb4f8ee618 service nova] Acquired lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:15:45 user nova-compute[72815]: DEBUG nova.network.neutron [req-e55a3722-621b-4482-bc0b-f148fcd5e548 req-493aff50-72b0-4725-8a1f-7dfb4f8ee618 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Refreshing network info cache for port 331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:15:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:45 user nova-compute[72815]: DEBUG nova.network.neutron [req-e55a3722-621b-4482-bc0b-f148fcd5e548 req-493aff50-72b0-4725-8a1f-7dfb4f8ee618 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updated VIF entry in instance network info cache for port 331a772e-61c5-4bbe-920e-f37642d7e012. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:15:45 user nova-compute[72815]: DEBUG nova.network.neutron [req-e55a3722-621b-4482-bc0b-f148fcd5e548 req-493aff50-72b0-4725-8a1f-7dfb4f8ee618 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updating instance_info_cache with network_info: [{"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:15:45 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:15:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:15:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e55a3722-621b-4482-bc0b-f148fcd5e548 req-493aff50-72b0-4725-8a1f-7dfb4f8ee618 service nova] Releasing lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:15:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:15:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-d7fe32fe-6e68-4484-8192-55734389a9bf req-bc468ee3-0bde-4148-a9e9-efcf12e64aab service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-changed-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-d7fe32fe-6e68-4484-8192-55734389a9bf req-bc468ee3-0bde-4148-a9e9-efcf12e64aab service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Refreshing instance network info cache due to event network-changed-331a772e-61c5-4bbe-920e-f37642d7e012. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:15:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d7fe32fe-6e68-4484-8192-55734389a9bf req-bc468ee3-0bde-4148-a9e9-efcf12e64aab service nova] Acquiring lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:15:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d7fe32fe-6e68-4484-8192-55734389a9bf req-bc468ee3-0bde-4148-a9e9-efcf12e64aab service nova] Acquired lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:15:47 user nova-compute[72815]: DEBUG nova.network.neutron [req-d7fe32fe-6e68-4484-8192-55734389a9bf req-bc468ee3-0bde-4148-a9e9-efcf12e64aab service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Refreshing network info cache for port 331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:15:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:47 user nova-compute[72815]: DEBUG nova.network.neutron [req-d7fe32fe-6e68-4484-8192-55734389a9bf req-bc468ee3-0bde-4148-a9e9-efcf12e64aab service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updated VIF entry in instance network info cache for port 331a772e-61c5-4bbe-920e-f37642d7e012. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:15:47 user nova-compute[72815]: DEBUG nova.network.neutron [req-d7fe32fe-6e68-4484-8192-55734389a9bf req-bc468ee3-0bde-4148-a9e9-efcf12e64aab service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updating instance_info_cache with network_info: [{"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:15:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d7fe32fe-6e68-4484-8192-55734389a9bf req-bc468ee3-0bde-4148-a9e9-efcf12e64aab service nova] Releasing lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:15:47 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:50 user nova-compute[72815]: INFO nova.compute.manager [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Terminating instance
Aug 17 20:15:50 user nova-compute[72815]: DEBUG nova.compute.manager [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-124acf45-8a86-4289-999e-7d6ee8f9799a req-7baf3319-8e05-46fd-b320-93aff64ac0d7 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received event network-vif-unplugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-124acf45-8a86-4289-999e-7d6ee8f9799a req-7baf3319-8e05-46fd-b320-93aff64ac0d7 service nova] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-124acf45-8a86-4289-999e-7d6ee8f9799a req-7baf3319-8e05-46fd-b320-93aff64ac0d7 service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-124acf45-8a86-4289-999e-7d6ee8f9799a req-7baf3319-8e05-46fd-b320-93aff64ac0d7 service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-124acf45-8a86-4289-999e-7d6ee8f9799a req-7baf3319-8e05-46fd-b320-93aff64ac0d7 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] No waiting events found dispatching network-vif-unplugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-124acf45-8a86-4289-999e-7d6ee8f9799a req-7baf3319-8e05-46fd-b320-93aff64ac0d7 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received event network-vif-unplugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:51 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Instance destroyed successfully.
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.objects.instance [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'resources' on Instance uuid ec0afde2-8d2b-451a-a226-be933e28ad6f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1153727331',display_name='tempest-ServerRescueNegativeTestJSON-server-1153727331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1153727331',id=20,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:01:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6d2cf2910f4d3d9924480d68057b5a',ramdisk_id='',reservation_id='r-z9z0cph6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-335799606',owner_user_name='tempest-ServerRescueNegativeTestJSON-335799606-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:01:23Z,user_data=None,user_id='fa27c69e40f243d9b38c87250b5dba5f',uuid=ec0afde2-8d2b-451a-a226-be933e28ad6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converting VIF {"id": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "address": "fa:16:3e:2f:69:15", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1dfe2e-5d", "ovs_interfaceid": "5c1dfe2e-5dea-442a-b69a-8ac17c027541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:69:15,bridge_name='br-int',has_traffic_filtering=True,id=5c1dfe2e-5dea-442a-b69a-8ac17c027541,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1dfe2e-5d') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG os_vif [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:69:15,bridge_name='br-int',has_traffic_filtering=True,id=5c1dfe2e-5dea-442a-b69a-8ac17c027541,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1dfe2e-5d') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c1dfe2e-5d, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:15:51 user nova-compute[72815]: INFO os_vif [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:69:15,bridge_name='br-int',has_traffic_filtering=True,id=5c1dfe2e-5dea-442a-b69a-8ac17c027541,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1dfe2e-5d')
Aug 17 20:15:51 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Deleting instance files /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f_del
Aug 17 20:15:51 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Deletion of /opt/stack/data/nova/instances/ec0afde2-8d2b-451a-a226-be933e28ad6f_del complete
Aug 17 20:15:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:51 user nova-compute[72815]: INFO nova.compute.manager [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Terminating instance
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:15:51 user nova-compute[72815]: INFO nova.compute.manager [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 17 20:15:51 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:51 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Instance destroyed successfully.
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lazy-loading 'resources' on Instance uuid 8ac64ac9-a49d-4c70-956b-3a140da5ede8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-89461310',display_name='tempest-ServersNegativeTestJSON-server-89461310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-89461310',id=32,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:07:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d68603e63804620b9bacd300d254000',ramdisk_id='',reservation_id='r-lbwp2gxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-128301023',owner_user_name='tempest-ServersNegativeTestJSON-128301023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:07:00Z,user_data=None,user_id='1c18f1cf89be4c63a7ad48ec390c6213',uuid=8ac64ac9-a49d-4c70-956b-3a140da5ede8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "049f8926-a1a3-431c-bf28-d08348e98b73", "address": "fa:16:3e:1f:94:21", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049f8926-a1", "ovs_interfaceid": "049f8926-a1a3-431c-bf28-d08348e98b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Converting VIF {"id": "049f8926-a1a3-431c-bf28-d08348e98b73", "address": "fa:16:3e:1f:94:21", "network": {"id": "794a0a7f-27a6-4936-b276-2c450a4b1cfd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1748039755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d68603e63804620b9bacd300d254000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049f8926-a1", "ovs_interfaceid": "049f8926-a1a3-431c-bf28-d08348e98b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:94:21,bridge_name='br-int',has_traffic_filtering=True,id=049f8926-a1a3-431c-bf28-d08348e98b73,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap049f8926-a1') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG os_vif [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:94:21,bridge_name='br-int',has_traffic_filtering=True,id=049f8926-a1a3-431c-bf28-d08348e98b73,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap049f8926-a1') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap049f8926-a1, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:15:51 user nova-compute[72815]: INFO os_vif [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:94:21,bridge_name='br-int',has_traffic_filtering=True,id=049f8926-a1a3-431c-bf28-d08348e98b73,network=Network(794a0a7f-27a6-4936-b276-2c450a4b1cfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap049f8926-a1')
Aug 17 20:15:51 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Deleting instance files /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8_del
Aug 17 20:15:51 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Deletion of /opt/stack/data/nova/instances/8ac64ac9-a49d-4c70-956b-3a140da5ede8_del complete
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:15:51 user nova-compute[72815]: INFO nova.compute.manager [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 17 20:15:51 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:15:51 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:15:51 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Took 0.73 seconds to deallocate network for instance.
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-55fb99e2-0f02-4d59-aa30-f30bc1327533 req-ca90b6b2-e3c1-4b27-bc45-45206928a789 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received event network-vif-deleted-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:52 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Deleted allocations for instance ec0afde2-8d2b-451a-a226-be933e28ad6f
Aug 17 20:15:52 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-39d022b4-9776-432f-9794-f4c91d54f3eb tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.156s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:52 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Took 0.62 seconds to deallocate network for instance.
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received event network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] Acquiring lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] Lock "ec0afde2-8d2b-451a-a226-be933e28ad6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] No waiting events found dispatching network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:15:52 user nova-compute[72815]: WARNING nova.compute.manager [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Received unexpected event network-vif-plugged-5c1dfe2e-5dea-442a-b69a-8ac17c027541 for instance with vm_state deleted and task_state None.
Aug 17 20:15:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Received event network-vif-unplugged-049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] Acquiring lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] No waiting events found dispatching network-vif-unplugged-049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:15:52 user nova-compute[72815]: WARNING nova.compute.manager [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Received unexpected event network-vif-unplugged-049f8926-a1a3-431c-bf28-d08348e98b73 for instance with vm_state deleted and task_state None.
Aug 17 20:15:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Received event network-vif-plugged-049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] Acquiring lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] No waiting events found dispatching network-vif-plugged-049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:15:52 user nova-compute[72815]: WARNING nova.compute.manager [req-e5b52e77-c18f-49af-b011-37b258aa72a7 req-8e0e8dab-5e73-47d1-a144-b59902205e82 service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Received unexpected event network-vif-plugged-049f8926-a1a3-431c-bf28-d08348e98b73 for instance with vm_state deleted and task_state None.
Aug 17 20:15:52 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:15:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:52 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Deleted allocations for instance 8ac64ac9-a49d-4c70-956b-3a140da5ede8
Aug 17 20:15:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f8534ec5-9442-455a-a5b9-7f6a85f84d2b tempest-ServersNegativeTestJSON-128301023 tempest-ServersNegativeTestJSON-128301023-project-member] Lock "8ac64ac9-a49d-4c70-956b-3a140da5ede8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.879s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-8fc8aedd-c5ad-4b3c-b6b0-82bf4628de38 req-ffe1c079-5814-4fc7-bb2f-51238fca15ac service nova] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Received event network-vif-deleted-049f8926-a1a3-431c-bf28-d08348e98b73 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:54 user nova-compute[72815]: INFO nova.compute.manager [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Rebooting instance
Aug 17 20:15:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:15:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquired lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:15:54 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:15:55 user nova-compute[72815]: DEBUG nova.network.neutron [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updating instance_info_cache with network_info: [{"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:15:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Releasing lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:15:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:15:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-24b6a043-1e3d-41f3-99df-cea470c78088 req-4f304468-d0fb-4aae-bcd8-41ac46a531ff service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-vif-unplugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-24b6a043-1e3d-41f3-99df-cea470c78088 req-4f304468-d0fb-4aae-bcd8-41ac46a531ff service nova] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-24b6a043-1e3d-41f3-99df-cea470c78088 req-4f304468-d0fb-4aae-bcd8-41ac46a531ff service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-24b6a043-1e3d-41f3-99df-cea470c78088 req-4f304468-d0fb-4aae-bcd8-41ac46a531ff service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-24b6a043-1e3d-41f3-99df-cea470c78088 req-4f304468-d0fb-4aae-bcd8-41ac46a531ff service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] No waiting events found dispatching network-vif-unplugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:15:55 user nova-compute[72815]: WARNING nova.compute.manager [req-24b6a043-1e3d-41f3-99df-cea470c78088 req-4f304468-d0fb-4aae-bcd8-41ac46a531ff service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received unexpected event network-vif-unplugged-331a772e-61c5-4bbe-920e-f37642d7e012 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 20:15:56 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Instance destroyed successfully.
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'resources' on Instance uuid 0145191d-46b5-458c-9e04-136bd4635d40 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:13:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1572011402',display_name='tempest-TestMinimumBasicScenario-server-1572011402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1572011402',id=41,image_ref='d056c8b4-77aa-433b-b557-9b79ffe99fcc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdcKNFaoSkdo7iHnLFkpML2OqmZhygzWP0YgyuNWEYFJ0wwOw/haiTNxzu8cIy4BmFv2SBgmUKXfdh2hXXKSf9ZkedCiO5b5CHkbGKuCKDBgfrzwHUR4zJIN+6BM4lQRA==',key_name='tempest-TestMinimumBasicScenario-1144594707',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:13:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6adbeb02ec1e45b3b7c2af06e7cb92cf',ramdisk_id='',reservation_id='r-s2sausqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d056c8b4-77aa-433b-b557-9b79ffe99fcc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1472868221',owner_user_name='tempest-TestMinimumBasicScenario-1472868221-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:15:55Z,user_data=None,user_id='39ef6674029a4e51bfd614a9a834970c',uuid=0145191d-46b5-458c-9e04-136bd4635d40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converting VIF {"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_vif [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap331a772e-61, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:15:56 user nova-compute[72815]: INFO os_vif [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61')
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLMCXWtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:15:56 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[870e047b-c428-4945-804d-643d5a1b9c2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[84665d04-a9c0-4726-8d92-1d3153552121]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:56 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:15:56 user nova-compute[72815]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:15:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:56 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:15:56 user nova-compute[72815]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:15:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994474040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d'): ({'sdd'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Removing single pathed devices sdd {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a9ed28-fe55-4fb9-a416-af3aaa71e790]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8d1507-97d2-4de4-b961-db3c0fa40fac]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Flushing IO for device /dev/sdd {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[141e8bff-6a13-464f-8a3d-ef32fe91879e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d4d603-3277-4551-a912-252bdc61469e]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1aa38a-95c2-4e97-9303-dddacd54b2ff]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[67120e50-0698-40b7-8e36-752a92d5c90d]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260]
Aug 17 20:15:56 user nova-compute[72815]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260] successful.
Aug 17 20:15:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f533a3-0dd9-4bba-aa55-a1305d193cd0]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] <== disconnect_volume: return (327ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Start _get_guest_xml network_info=[{"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d056c8b4-77aa-433b-b557-9b79ffe99fcc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': 'd056c8b4-77aa-433b-b557-9b79ffe99fcc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': '5850f351-7b2d-4192-8dcb-6923c0091ae2', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLMCXWtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '0145191d-46b5-458c-9e04-136bd4635d40', 'attached_at': '', 'detached_at': '', 'volume_id': 'a479307e-e873-4e7a-bde9-d2d235f6201d', 'serial': 'a479307e-e873-4e7a-bde9-d2d235f6201d'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:15:56 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:15:56 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d056c8b4-77aa-433b-b557-9b79ffe99fcc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0145191d-46b5-458c-9e04-136bd4635d40 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLMCXWtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:15:56 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:15:56 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:15:56 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0682bde0-a5a4-41de-9a80-f7707b378a57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:15:56 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08c9fed-6bee-42e4-956b-7838b2deacb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d] added
Aug 17 20:15:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1998ed68-3a17-4c7b-b8fd-ce72e1177481]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43800a5-9e67-4277-8b60-9088334c8163]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLMCXWtr {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLMCXWtr" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb54f78-c024-4e7b-9cb1-47137bca2755]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZLMCXWtr'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[082ea5d3-ef01-4d1d-b0ad-075698aae5b2]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5825ca6e-fc95-41a7-9bf3-8aa1b67b935c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:56 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:15:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:56 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:15:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0424aa6-4545-4270-9aaf-fdc24427889e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260]
Aug 17 20:15:56 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260] successful.
Aug 17 20:15:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[432140ce-31b3-4242-b87f-e25ee6778740]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b4430e-ebc8-4fd1-b80e-203e08a2ad8c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:56 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:15:56 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:15:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:15:56 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:15:56 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:15:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29d4017-93a3-4e62-92da-3e606f3acae2]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:15:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-f813ca6b-8628-476f-a8d5-23624e6d7983 req-46ad5bf6-8c15-4780-8396-39ac195e6756 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f813ca6b-8628-476f-a8d5-23624e6d7983 req-46ad5bf6-8c15-4780-8396-39ac195e6756 service nova] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f813ca6b-8628-476f-a8d5-23624e6d7983 req-46ad5bf6-8c15-4780-8396-39ac195e6756 service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f813ca6b-8628-476f-a8d5-23624e6d7983 req-46ad5bf6-8c15-4780-8396-39ac195e6756 service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-f813ca6b-8628-476f-a8d5-23624e6d7983 req-46ad5bf6-8c15-4780-8396-39ac195e6756 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] No waiting events found dispatching network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:15:57 user nova-compute[72815]: WARNING nova.compute.manager [req-f813ca6b-8628-476f-a8d5-23624e6d7983 req-46ad5bf6-8c15-4780-8396-39ac195e6756 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received unexpected event network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 20:15:57 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLMCXWtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23932633239306333', 'path': '/dev/sdd'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932633239306333', 'path': '/dev/sdd'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:13:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1572011402',display_name='tempest-TestMinimumBasicScenario-server-1572011402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1572011402',id=41,image_ref='d056c8b4-77aa-433b-b557-9b79ffe99fcc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdcKNFaoSkdo7iHnLFkpML2OqmZhygzWP0YgyuNWEYFJ0wwOw/haiTNxzu8cIy4BmFv2SBgmUKXfdh2hXXKSf9ZkedCiO5b5CHkbGKuCKDBgfrzwHUR4zJIN+6BM4lQRA==',key_name='tempest-TestMinimumBasicScenario-1144594707',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:13:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6adbeb02ec1e45b3b7c2af06e7cb92cf',ramdisk_id='',reservation_id='r-s2sausqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d056c8b4-77aa-433b-b557-9b79ffe99fcc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1472868221',owner_user_name='tempest-TestMinimumBasicScenario-1472868221-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:15:55Z,user_data=None,user_id='39ef6674029a4e51bfd614a9a834970c',uuid=0145191d-46b5-458c-9e04-136bd4635d40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converting VIF {"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'pci_devices' on Instance uuid 0145191d-46b5-458c-9e04-136bd4635d40 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:15:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:15:57 user nova-compute[72815]:   <uuid>0145191d-46b5-458c-9e04-136bd4635d40</uuid>
Aug 17 20:15:57 user nova-compute[72815]:   <name>instance-00000029</name>
Aug 17 20:15:57 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:15:57 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:15:57 user nova-compute[72815]:   <metadata>
Aug 17 20:15:57 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:15:57 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:15:57 user nova-compute[72815]:       <nova:name>tempest-TestMinimumBasicScenario-server-1572011402</nova:name>
Aug 17 20:15:57 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:15:56</nova:creationTime>
Aug 17 20:15:57 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:15:57 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:15:57 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:15:57 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:15:57 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:15:57 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:15:57 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:15:57 user nova-compute[72815]:       <nova:owner>
Aug 17 20:15:57 user nova-compute[72815]:         <nova:user uuid="39ef6674029a4e51bfd614a9a834970c">tempest-TestMinimumBasicScenario-1472868221-project-member</nova:user>
Aug 17 20:15:57 user nova-compute[72815]:         <nova:project uuid="6adbeb02ec1e45b3b7c2af06e7cb92cf">tempest-TestMinimumBasicScenario-1472868221</nova:project>
Aug 17 20:15:57 user nova-compute[72815]:       </nova:owner>
Aug 17 20:15:57 user nova-compute[72815]:       <nova:root type="image" uuid="d056c8b4-77aa-433b-b557-9b79ffe99fcc"/>
Aug 17 20:15:57 user nova-compute[72815]:       <nova:ports>
Aug 17 20:15:57 user nova-compute[72815]:         <nova:port uuid="331a772e-61c5-4bbe-920e-f37642d7e012">
Aug 17 20:15:57 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 20:15:57 user nova-compute[72815]:         </nova:port>
Aug 17 20:15:57 user nova-compute[72815]:       </nova:ports>
Aug 17 20:15:57 user nova-compute[72815]:     </nova:instance>
Aug 17 20:15:57 user nova-compute[72815]:   </metadata>
Aug 17 20:15:57 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:15:57 user nova-compute[72815]:     <system>
Aug 17 20:15:57 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:15:57 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:15:57 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:15:57 user nova-compute[72815]:       <entry name="serial">0145191d-46b5-458c-9e04-136bd4635d40</entry>
Aug 17 20:15:57 user nova-compute[72815]:       <entry name="uuid">0145191d-46b5-458c-9e04-136bd4635d40</entry>
Aug 17 20:15:57 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:15:57 user nova-compute[72815]:     </system>
Aug 17 20:15:57 user nova-compute[72815]:   </sysinfo>
Aug 17 20:15:57 user nova-compute[72815]:   <os>
Aug 17 20:15:57 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:15:57 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:15:57 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:15:57 user nova-compute[72815]:   </os>
Aug 17 20:15:57 user nova-compute[72815]:   <features>
Aug 17 20:15:57 user nova-compute[72815]:     <acpi/>
Aug 17 20:15:57 user nova-compute[72815]:     <apic/>
Aug 17 20:15:57 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:15:57 user nova-compute[72815]:   </features>
Aug 17 20:15:57 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:15:57 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:15:57 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:15:57 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:15:57 user nova-compute[72815]:   </clock>
Aug 17 20:15:57 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:15:57 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:15:57 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:15:57 user nova-compute[72815]:   </cpu>
Aug 17 20:15:57 user nova-compute[72815]:   <devices>
Aug 17 20:15:57 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:15:57 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:15:57 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk"/>
Aug 17 20:15:57 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:15:57 user nova-compute[72815]:     </disk>
Aug 17 20:15:57 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:15:57 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:15:57 user nova-compute[72815]:       <source dev="/dev/sdd"/>
Aug 17 20:15:57 user nova-compute[72815]:       <target dev="vdb" bus="virtio"/>
Aug 17 20:15:57 user nova-compute[72815]:       <serial>a479307e-e873-4e7a-bde9-d2d235f6201d</serial>
Aug 17 20:15:57 user nova-compute[72815]:     </disk>
Aug 17 20:15:57 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:15:57 user nova-compute[72815]:       <mac address="fa:16:3e:fa:90:a8"/>
Aug 17 20:15:57 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:15:57 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:15:57 user nova-compute[72815]:       <target dev="tap331a772e-61"/>
Aug 17 20:15:57 user nova-compute[72815]:     </interface>
Aug 17 20:15:57 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:15:57 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/console.log" append="off"/>
Aug 17 20:15:57 user nova-compute[72815]:     </serial>
Aug 17 20:15:57 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:15:57 user nova-compute[72815]:     <video>
Aug 17 20:15:57 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:15:57 user nova-compute[72815]:     </video>
Aug 17 20:15:57 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:15:57 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:15:57 user nova-compute[72815]:     </rng>
Aug 17 20:15:57 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:15:57 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:15:57 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:15:57 user nova-compute[72815]:     </memballoon>
Aug 17 20:15:57 user nova-compute[72815]:   </devices>
Aug 17 20:15:57 user nova-compute[72815]: </domain>
Aug 17 20:15:57 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0145191d-46b5-458c-9e04-136bd4635d40 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79 --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Cannot resize image /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'migration_context' on Instance uuid 0145191d-46b5-458c-9e04-136bd4635d40 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:13:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1572011402',display_name='tempest-TestMinimumBasicScenario-server-1572011402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1572011402',id=41,image_ref='d056c8b4-77aa-433b-b557-9b79ffe99fcc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdcKNFaoSkdo7iHnLFkpML2OqmZhygzWP0YgyuNWEYFJ0wwOw/haiTNxzu8cIy4BmFv2SBgmUKXfdh2hXXKSf9ZkedCiO5b5CHkbGKuCKDBgfrzwHUR4zJIN+6BM4lQRA==',key_name='tempest-TestMinimumBasicScenario-1144594707',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:13:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='6adbeb02ec1e45b3b7c2af06e7cb92cf',ramdisk_id='',reservation_id='r-s2sausqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d056c8b4-77aa-433b-b557-9b79ffe99fcc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1472868221',owner_user_name='tempest-TestMinimumBasicScenario-1472868221-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:15:55Z,user_data=None,user_id='39ef6674029a4e51bfd614a9a834970c',uuid=0145191d-46b5-458c-9e04-136bd4635d40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converting VIF {"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG os_vif [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap331a772e-61, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap331a772e-61, col_values=(('external_ids', {'iface-id': '331a772e-61c5-4bbe-920e-f37642d7e012', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:90:a8', 'vm-uuid': '0145191d-46b5-458c-9e04-136bd4635d40'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:15:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:15:58 user nova-compute[72815]: INFO os_vif [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61')
Aug 17 20:16:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:00 user nova-compute[72815]: DEBUG nova.compute.manager [req-d91e1c4a-2bfe-4d95-ae28-1fc048fde980 req-ba8cb1df-b879-4d3b-9e15-83d8720f49ab service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d91e1c4a-2bfe-4d95-ae28-1fc048fde980 req-ba8cb1df-b879-4d3b-9e15-83d8720f49ab service nova] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d91e1c4a-2bfe-4d95-ae28-1fc048fde980 req-ba8cb1df-b879-4d3b-9e15-83d8720f49ab service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d91e1c4a-2bfe-4d95-ae28-1fc048fde980 req-ba8cb1df-b879-4d3b-9e15-83d8720f49ab service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:00 user nova-compute[72815]: DEBUG nova.compute.manager [req-d91e1c4a-2bfe-4d95-ae28-1fc048fde980 req-ba8cb1df-b879-4d3b-9e15-83d8720f49ab service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] No waiting events found dispatching network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:16:00 user nova-compute[72815]: WARNING nova.compute.manager [req-d91e1c4a-2bfe-4d95-ae28-1fc048fde980 req-ba8cb1df-b879-4d3b-9e15-83d8720f49ab service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received unexpected event network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 20:16:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-1ee73d68-e93b-44e3-a9f3-1b412aee2532 req-8c2a8588-f46d-4d07-a10a-3c32fba25156 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Received event network-changed-36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-1ee73d68-e93b-44e3-a9f3-1b412aee2532 req-8c2a8588-f46d-4d07-a10a-3c32fba25156 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Refreshing instance network info cache due to event network-changed-36bdea48-bb16-4017-9627-8c87a2fa6d13. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:16:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ee73d68-e93b-44e3-a9f3-1b412aee2532 req-8c2a8588-f46d-4d07-a10a-3c32fba25156 service nova] Acquiring lock "refresh_cache-37ce6156-441f-4e86-89c1-9a3b1590df47" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:16:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ee73d68-e93b-44e3-a9f3-1b412aee2532 req-8c2a8588-f46d-4d07-a10a-3c32fba25156 service nova] Acquired lock "refresh_cache-37ce6156-441f-4e86-89c1-9a3b1590df47" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:16:01 user nova-compute[72815]: DEBUG nova.network.neutron [req-1ee73d68-e93b-44e3-a9f3-1b412aee2532 req-8c2a8588-f46d-4d07-a10a-3c32fba25156 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Refreshing network info cache for port 36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for 0145191d-46b5-458c-9e04-136bd4635d40 due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303362.45453, 0145191d-46b5-458c-9e04-136bd4635d40 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:16:02 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] VM Resumed (Lifecycle Event)
Aug 17 20:16:02 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Instance rebooted successfully.
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:16:02 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303362.4558864, 0145191d-46b5-458c-9e04-136bd4635d40 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:16:02 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] VM Started (Lifecycle Event)
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7f69658c-11dc-4acc-8103-80350614344b tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.954s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-6561f1d9-6ab7-4a05-ba69-df9e1ce8dfec req-e21f8003-103a-48d2-94cf-878a83c792a0 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6561f1d9-6ab7-4a05-ba69-df9e1ce8dfec req-e21f8003-103a-48d2-94cf-878a83c792a0 service nova] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6561f1d9-6ab7-4a05-ba69-df9e1ce8dfec req-e21f8003-103a-48d2-94cf-878a83c792a0 service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6561f1d9-6ab7-4a05-ba69-df9e1ce8dfec req-e21f8003-103a-48d2-94cf-878a83c792a0 service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-6561f1d9-6ab7-4a05-ba69-df9e1ce8dfec req-e21f8003-103a-48d2-94cf-878a83c792a0 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] No waiting events found dispatching network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:16:02 user nova-compute[72815]: WARNING nova.compute.manager [req-6561f1d9-6ab7-4a05-ba69-df9e1ce8dfec req-e21f8003-103a-48d2-94cf-878a83c792a0 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received unexpected event network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 for instance with vm_state active and task_state None.
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.network.neutron [req-1ee73d68-e93b-44e3-a9f3-1b412aee2532 req-8c2a8588-f46d-4d07-a10a-3c32fba25156 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Updated VIF entry in instance network info cache for port 36bdea48-bb16-4017-9627-8c87a2fa6d13. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG nova.network.neutron [req-1ee73d68-e93b-44e3-a9f3-1b412aee2532 req-8c2a8588-f46d-4d07-a10a-3c32fba25156 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Updating instance_info_cache with network_info: [{"id": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "address": "fa:16:3e:8b:a3:dc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36bdea48-bb", "ovs_interfaceid": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:16:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1ee73d68-e93b-44e3-a9f3-1b412aee2532 req-8c2a8588-f46d-4d07-a10a-3c32fba25156 service nova] Releasing lock "refresh_cache-37ce6156-441f-4e86-89c1-9a3b1590df47" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:16:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-52650672-fc85-4cc9-af4e-adcff0dc087c req-3eb29f8c-99f1-4906-be84-1a42179fe72e service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event network-changed-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-52650672-fc85-4cc9-af4e-adcff0dc087c req-3eb29f8c-99f1-4906-be84-1a42179fe72e service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Refreshing instance network info cache due to event network-changed-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:16:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-52650672-fc85-4cc9-af4e-adcff0dc087c req-3eb29f8c-99f1-4906-be84-1a42179fe72e service nova] Acquiring lock "refresh_cache-eb1a22c1-175e-480f-9ddf-cd297df993c8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:16:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-52650672-fc85-4cc9-af4e-adcff0dc087c req-3eb29f8c-99f1-4906-be84-1a42179fe72e service nova] Acquired lock "refresh_cache-eb1a22c1-175e-480f-9ddf-cd297df993c8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:16:03 user nova-compute[72815]: DEBUG nova.network.neutron [req-52650672-fc85-4cc9-af4e-adcff0dc087c req-3eb29f8c-99f1-4906-be84-1a42179fe72e service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Refreshing network info cache for port 9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:16:03 user nova-compute[72815]: DEBUG nova.network.neutron [req-52650672-fc85-4cc9-af4e-adcff0dc087c req-3eb29f8c-99f1-4906-be84-1a42179fe72e service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Updated VIF entry in instance network info cache for port 9d809bd7-984f-4bdd-8d4c-76fbe05ec68c. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:16:03 user nova-compute[72815]: DEBUG nova.network.neutron [req-52650672-fc85-4cc9-af4e-adcff0dc087c req-3eb29f8c-99f1-4906-be84-1a42179fe72e service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Updating instance_info_cache with network_info: [{"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:16:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-52650672-fc85-4cc9-af4e-adcff0dc087c req-3eb29f8c-99f1-4906-be84-1a42179fe72e service nova] Releasing lock "refresh_cache-eb1a22c1-175e-480f-9ddf-cd297df993c8" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:16:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:04 user nova-compute[72815]: INFO nova.compute.manager [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Rebuilding instance
Aug 17 20:16:04 user nova-compute[72815]: DEBUG nova.objects.instance [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lazy-loading 'trusted_certs' on Instance uuid eb1a22c1-175e-480f-9ddf-cd297df993c8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG nova.objects.instance [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lazy-loading 'pci_requests' on Instance uuid eb1a22c1-175e-480f-9ddf-cd297df993c8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG nova.objects.instance [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lazy-loading 'pci_devices' on Instance uuid eb1a22c1-175e-480f-9ddf-cd297df993c8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG nova.objects.instance [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lazy-loading 'resources' on Instance uuid eb1a22c1-175e-480f-9ddf-cd297df993c8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG nova.objects.instance [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lazy-loading 'migration_context' on Instance uuid eb1a22c1-175e-480f-9ddf-cd297df993c8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG nova.objects.instance [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72815) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-5978f1ee-2d7a-4614-8cff-2468176aa1a1 req-6e8cf378-ca89-4089-92a7-b0865130416e service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event network-vif-unplugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5978f1ee-2d7a-4614-8cff-2468176aa1a1 req-6e8cf378-ca89-4089-92a7-b0865130416e service nova] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5978f1ee-2d7a-4614-8cff-2468176aa1a1 req-6e8cf378-ca89-4089-92a7-b0865130416e service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5978f1ee-2d7a-4614-8cff-2468176aa1a1 req-6e8cf378-ca89-4089-92a7-b0865130416e service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-5978f1ee-2d7a-4614-8cff-2468176aa1a1 req-6e8cf378-ca89-4089-92a7-b0865130416e service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] No waiting events found dispatching network-vif-unplugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:16:04 user nova-compute[72815]: WARNING nova.compute.manager [req-5978f1ee-2d7a-4614-8cff-2468176aa1a1 req-6e8cf378-ca89-4089-92a7-b0865130416e service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received unexpected event network-vif-unplugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c for instance with vm_state active and task_state rebuilding.
Aug 17 20:16:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Instance destroyed successfully.
Aug 17 20:16:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Instance destroyed successfully.
Aug 17 20:16:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1731405860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1306781066',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT7QCi8nId/iu4W4vvmCjsuZSx5jxi+6/A/TppcD7spua4Voq9EKV3Cbyn1NISMYCmgMHcmF2qyJPdVxn7gfwy+H7ZUMeDJ7/t4NxqxTvVHfq3jjyoTa4Leb+MiNll4+g==',key_name='tempest-keypair-1418290547',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:14:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d85890dbab214814b52076eb232cac3f',ramdisk_id='',reservation_id='r-nkq44203',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-568249167',owner_user_name='tempest-ServerActionsV293TestJSON-568249167-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:16:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3fc7666dca14c5791054aa3cb89ebb3',uuid=eb1a22c1-175e-480f-9ddf-cd297df993c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Converting VIF {"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_vif [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d809bd7-98, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:16:05 user nova-compute[72815]: INFO os_vif [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98')
Aug 17 20:16:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHyCLGeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:16:05 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2a2cd4-fbb6-414e-b91a-081871111b4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8a15e0-2e27-47c0-bf94-40e4579a8391]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:16:05 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:05 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:16:05 user nova-compute[72815]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:05 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944757e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea'): ({'sdb'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Removing single pathed devices sdb {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb346c62-6f84-4eb3-9861-2ca71841a0a1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.036s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4731488-0ab5-40a8-818a-e29d736b0f9f]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Flushing IO for device /dev/sdb {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ebe52-d53b-42c0-9471-a7e8cee5e145]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.098s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ae7eec-35d0-46f7-9e9a-25f489f7f5e5]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26531323635383432', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_af0be57c', '/dev/disk/by-id/scsi-1SCST_BIOaf0be57c-e1265842a44ecba7') {{(pid=84269) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe9933b-72b3-4343-bc6c-551467244a77]: (4, None) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[217acc3b-a8d0-4f8a-add9-f2f77cb0742e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[50313961-f568-47ca-b259-4b4d134b2f2f]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260]
Aug 17 20:16:05 user nova-compute[72815]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260] successful.
Aug 17 20:16:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f294306-beae-4f18-8192-931ef41a90d8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] <== disconnect_volume: return (387ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:16:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Deleting instance files /opt/stack/data/nova/instances/eb1a22c1-175e-480f-9ddf-cd297df993c8_del
Aug 17 20:16:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Deletion of /opt/stack/data/nova/instances/eb1a22c1-175e-480f-9ddf-cd297df993c8_del complete
Aug 17 20:16:05 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance eb1a22c1-175e-480f-9ddf-cd297df993c8 could not be found.
Aug 17 20:16:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHyCLGeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:16:05 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bccdaa-c085-43de-a767-2c393d06d93f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e07238b-e74a-4d7d-aa2a-bddb5fd71e40]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:05 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:05 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39c40735b0>, {}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Disconnecting from: [] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] <== disconnect_volume: return (55ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:16:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303351.0135772, ec0afde2-8d2b-451a-a226-be933e28ad6f => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:16:06 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] VM Stopped (Lifecycle Event)
Aug 17 20:16:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bc74b6d8-95ad-4ad7-87c0-e0660ea6130b None None] [instance: ec0afde2-8d2b-451a-a226-be933e28ad6f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "37ce6156-441f-4e86-89c1-9a3b1590df47" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG nova.objects.instance [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'flavor' on Instance uuid 37ce6156-441f-4e86-89c1-9a3b1590df47 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303351.7968805, 8ac64ac9-a49d-4c70-956b-3a140da5ede8 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:16:06 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] VM Stopped (Lifecycle Event)
Aug 17 20:16:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-acc7cb22-ad67-43d3-b3ca-a0f75f0378fb req-ea9bf8b9-145a-4df6-a6b0-ed8bf9f8c25d service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-acc7cb22-ad67-43d3-b3ca-a0f75f0378fb req-ea9bf8b9-145a-4df6-a6b0-ed8bf9f8c25d service nova] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-acc7cb22-ad67-43d3-b3ca-a0f75f0378fb req-ea9bf8b9-145a-4df6-a6b0-ed8bf9f8c25d service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-acc7cb22-ad67-43d3-b3ca-a0f75f0378fb req-ea9bf8b9-145a-4df6-a6b0-ed8bf9f8c25d service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-acc7cb22-ad67-43d3-b3ca-a0f75f0378fb req-ea9bf8b9-145a-4df6-a6b0-ed8bf9f8c25d service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] No waiting events found dispatching network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:16:06 user nova-compute[72815]: WARNING nova.compute.manager [req-acc7cb22-ad67-43d3-b3ca-a0f75f0378fb req-ea9bf8b9-145a-4df6-a6b0-ed8bf9f8c25d service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received unexpected event network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c for instance with vm_state active and task_state rebuilding.
Aug 17 20:16:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-993f3a99-b4c5-446f-9e79-39c7bbf33942 None None] [instance: 8ac64ac9-a49d-4c70-956b-3a140da5ede8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "37ce6156-441f-4e86-89c1-9a3b1590df47" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:06 user nova-compute[72815]: INFO nova.compute.manager [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Attaching volume 11ee44e3-103f-4459-b91c-73f1f0b50a8f to /dev/vdb
Aug 17 20:16:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Preparing to wait for external event volume-reimaged-a87d5356-8d0f-4d8d-97c1-863f303090ea {{(pid=72815) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG os_brick.utils [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[611ae66c-66d4-4844-9aca-ee1cf76e90db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c01788-00b0-4b7f-b55b-bc1d805e7752]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057df44-9513-4ef8-8efa-1213afe676c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[42667ed6-ea5f-47a9-810c-3e020080a615]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:16:07 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:16:07 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f853842-7d7f-480a-b57f-b0d3189e7388]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG os_brick.utils [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Updating existing volume attachment record: e5529003-e826-4b81-a4d7-4c30d65d72c5 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:16:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELCMYSAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:16:18 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:16:18 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:16:18 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d430e39-ffeb-4beb-bce2-75dde759ec8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:16:18 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[31946f77-55cf-4bc4-b997-0b530c641689]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f] added
Aug 17 20:16:18 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3e1394-75b2-4e2e-892f-6104604f9b9d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bb951b-cbc1-4f4f-a43c-e881b4027fb0]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELCMYSAp {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELCMYSAp" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2e7fd7-14a6-4b54-b355-d3519480c7eb]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELCMYSAp'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f7f7fb-f87a-4f4b-88b1-536e6b45c4c1]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7f6048-d517-4ef4-bfa8-e783c389ab12]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:18 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:18 user nova-compute[72815]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:16:18 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:18 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:18 user nova-compute[72815]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:16:18 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a860dfa4-c3e3-4bf3-b9a4-a144ce047d88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f, portal: 172.16.0.220,3260]
Aug 17 20:16:18 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f, portal: 172.16.0.220,3260] successful.
Aug 17 20:16:18 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d5635e-76bd-4b3b-b918-34039cd6b006]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec13289b-5ce7-4412-8854-cee885bf08b6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:18 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:18 user nova-compute[72815]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:16:18 user nova-compute[72815]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f (non-flash)
Aug 17 20:16:18 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:18 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:18 user nova-compute[72815]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:16:18 user nova-compute[72815]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f (non-flash)
Aug 17 20:16:18 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] HCTL ('36', '-', '-', 0) found on session 52 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[47024990-29ed-4cfd-9e49-eba0a3cb7f67]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:18 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:16:19 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:16:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELCMYSAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:16:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:16:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23164623339353039', 'path': '/dev/sde'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:16:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164623339353039', 'path': '/dev/sde'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:16:19 user nova-compute[72815]: DEBUG nova.objects.instance [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'flavor' on Instance uuid 37ce6156-441f-4e86-89c1-9a3b1590df47 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:16:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:16:19 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:16:19 user nova-compute[72815]:   <source dev="/dev/sde"/>
Aug 17 20:16:19 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:16:19 user nova-compute[72815]:   <serial>11ee44e3-103f-4459-b91c-73f1f0b50a8f</serial>
Aug 17 20:16:19 user nova-compute[72815]: </disk>
Aug 17 20:16:19 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:16:20 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303365.2268205, eb1a22c1-175e-480f-9ddf-cd297df993c8 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:16:20 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] VM Stopped (Lifecycle Event)
Aug 17 20:16:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-10e06958-a1e3-4b4e-91f4-cfb8aa2deee7 None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:16:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:16:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:16:20 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] No VIF found with MAC fa:16:3e:8b:a3:dc, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:16:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-674d97e1-94b0-4afc-a909-9463c3d0b981 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.643s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "37ce6156-441f-4e86-89c1-9a3b1590df47" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:21 user nova-compute[72815]: INFO nova.compute.manager [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Detaching volume 11ee44e3-103f-4459-b91c-73f1f0b50a8f
Aug 17 20:16:21 user nova-compute[72815]: INFO nova.virt.block_device [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Attempting to driver detach volume 11ee44e3-103f-4459-b91c-73f1f0b50a8f from mountpoint /dev/vdb
Aug 17 20:16:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Attempting to detach device vdb from instance 37ce6156-441f-4e86-89c1-9a3b1590df47 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:16:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:16:21 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:16:21 user nova-compute[72815]:   <source dev="/dev/sde"/>
Aug 17 20:16:21 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:16:21 user nova-compute[72815]:   <serial>11ee44e3-103f-4459-b91c-73f1f0b50a8f</serial>
Aug 17 20:16:21 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:16:21 user nova-compute[72815]: </disk>
Aug 17 20:16:21 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:16:21 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully detached device vdb from instance 37ce6156-441f-4e86-89c1-9a3b1590df47 from the persistent domain config.
Aug 17 20:16:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 37ce6156-441f-4e86-89c1-9a3b1590df47 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:16:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:16:21 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:16:21 user nova-compute[72815]:   <source dev="/dev/sde"/>
Aug 17 20:16:21 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:16:21 user nova-compute[72815]:   <serial>11ee44e3-103f-4459-b91c-73f1f0b50a8f</serial>
Aug 17 20:16:21 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:16:21 user nova-compute[72815]: </disk>
Aug 17 20:16:21 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692303382.0457096, 37ce6156-441f-4e86-89c1-9a3b1590df47 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 37ce6156-441f-4e86-89c1-9a3b1590df47 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:16:22 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully detached device vdb from instance 37ce6156-441f-4e86-89c1-9a3b1590df47 from the live domain config.
Aug 17 20:16:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELCMYSAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:16:22 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a9d9b4-4629-4bb3-b9bd-afd616905dff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea0e8fd-8b25-4a34-8df1-58667c838708]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:22 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:22 user nova-compute[72815]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:16:22 user nova-compute[72815]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f (non-flash)
Aug 17 20:16:22 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:22 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:22 user nova-compute[72815]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:16:22 user nova-compute[72815]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f (non-flash)
Aug 17 20:16:22 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39b420e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f'): ({'sde'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Removing single pathed devices sde {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a605014-599c-4831-9701-74644f6a5c95]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83874e0-5c0d-4e4d-bfed-2d504547fdce]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Flushing IO for device /dev/sde {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ad8037-222e-48c3-b387-285c3afbecbc]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.061s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc22ffa-bc22-44d5-91e9-e46661efeb79]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] SCSI volumes sde have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f01f52-de91-499b-a939-ee98da5d374f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a241eae5-e04b-4cc1-ad87-c7984afd11b9]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f, portal: 172.16.0.220,3260]
Aug 17 20:16:22 user nova-compute[72815]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f, portal: 172.16.0.220,3260] successful.
Aug 17 20:16:22 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ee44e3-103f-4459-b91c-73f1f0b50a8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e2e4f3-986f-43a5-9d1c-e37038426960]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] <== disconnect_volume: return (334ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:16:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:16:23 user nova-compute[72815]: DEBUG nova.objects.instance [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'flavor' on Instance uuid 37ce6156-441f-4e86-89c1-9a3b1590df47 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:16:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-c631a014-88e7-448e-adc1-22b8653e8500 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.815s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG nova.compute.manager [req-25fab605-9955-46c2-800a-5e1352a9d34e req-90382d31-0e3f-483f-8f88-bfe26c606c9b service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event volume-reimaged-a87d5356-8d0f-4d8d-97c1-863f303090ea {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-25fab605-9955-46c2-800a-5e1352a9d34e req-90382d31-0e3f-483f-8f88-bfe26c606c9b service nova] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-25fab605-9955-46c2-800a-5e1352a9d34e req-90382d31-0e3f-483f-8f88-bfe26c606c9b service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-25fab605-9955-46c2-800a-5e1352a9d34e req-90382d31-0e3f-483f-8f88-bfe26c606c9b service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG nova.compute.manager [req-25fab605-9955-46c2-800a-5e1352a9d34e req-90382d31-0e3f-483f-8f88-bfe26c606c9b service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Processing event volume-reimaged-a87d5356-8d0f-4d8d-97c1-863f303090ea {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG nova.compute.manager [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:16:27 user nova-compute[72815]: INFO nova.virt.block_device [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Booting with volume a87d5356-8d0f-4d8d-97c1-863f303090ea at /dev/vda
Aug 17 20:16:27 user nova-compute[72815]: DEBUG os_brick.utils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb0a1e2-bee8-47f1-bb80-dae794bab527]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bd8bf2-eb3c-42f1-b14b-ce27a2fb64c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c48d652-4297-4b36-81dc-6d16ae02deca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3625390-0fd2-43b0-8598-857b0824adb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:16:27 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:16:27 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[93556f2e-3682-4c4e-ac63-e6c1e2f312d2]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG os_brick.utils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:16:27 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Updating existing volume attachment record: 3c61b26b-a6ee-487e-a811-f8a68623414d {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:16:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:16:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:16:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:16:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:38 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:16:38 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7717MB free_disk=25.321796417236328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 99693a7e-71e3-4543-b649-41a147c77c7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 0145191d-46b5-458c-9e04-136bd4635d40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 37ce6156-441f-4e86-89c1-9a3b1590df47 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance eb1a22c1-175e-480f-9ddf-cd297df993c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance c3a35887-4756-41ee-ba99-5b4e9fef7a80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:16:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:40 user nova-compute[72815]: INFO nova.compute.manager [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Terminating instance
Aug 17 20:16:40 user nova-compute[72815]: DEBUG nova.compute.manager [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:16:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:41 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Instance destroyed successfully.
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lazy-loading 'resources' on Instance uuid dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-999185640',display_name='tempest-ServerRescueNegativeTestJSON-server-999185640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-999185640',id=19,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:04:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6d2cf2910f4d3d9924480d68057b5a',ramdisk_id='',reservation_id='r-srtg51rj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-335799606',owner_user_name='tempest-ServerRescueNegativeTestJSON-335799606-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:06:07Z,user_data=None,user_id='fa27c69e40f243d9b38c87250b5dba5f',uuid=dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converting VIF {"id": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "address": "fa:16:3e:89:78:60", "network": {"id": "e7082c0f-6340-44bc-93d7-887929d387c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2126997163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d2cf2910f4d3d9924480d68057b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7d0039-07", "ovs_interfaceid": "7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:78:60,bridge_name='br-int',has_traffic_filtering=True,id=7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7d0039-07') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_vif [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:78:60,bridge_name='br-int',has_traffic_filtering=True,id=7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7d0039-07') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-bdd686a6-1bf9-4a8a-ac8b-32712c850794 req-2189fbcc-0059-4959-bbc5-ba4b64b1333c service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-unplugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bdd686a6-1bf9-4a8a-ac8b-32712c850794 req-2189fbcc-0059-4959-bbc5-ba4b64b1333c service nova] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bdd686a6-1bf9-4a8a-ac8b-32712c850794 req-2189fbcc-0059-4959-bbc5-ba4b64b1333c service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bdd686a6-1bf9-4a8a-ac8b-32712c850794 req-2189fbcc-0059-4959-bbc5-ba4b64b1333c service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-bdd686a6-1bf9-4a8a-ac8b-32712c850794 req-2189fbcc-0059-4959-bbc5-ba4b64b1333c service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] No waiting events found dispatching network-vif-unplugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.compute.manager [req-bdd686a6-1bf9-4a8a-ac8b-32712c850794 req-2189fbcc-0059-4959-bbc5-ba4b64b1333c service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-unplugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f7d0039-07, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:16:41 user nova-compute[72815]: INFO os_vif [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:78:60,bridge_name='br-int',has_traffic_filtering=True,id=7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe,network=Network(e7082c0f-6340-44bc-93d7-887929d387c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7d0039-07')
Aug 17 20:16:41 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Deleting instance files /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2_del
Aug 17 20:16:41 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Deletion of /opt/stack/data/nova/instances/dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2_del complete
Aug 17 20:16:41 user nova-compute[72815]: INFO nova.compute.manager [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:16:41 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Creating image(s)
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Ensure instance console log exists: /opt/stack/data/nova/instances/eb1a22c1-175e-480f-9ddf-cd297df993c8/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Start _get_guest_xml network_info=[{"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '3c61b26b-a6ee-487e-a811-f8a68623414d', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHyCLGeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb1a22c1-175e-480f-9ddf-cd297df993c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a87d5356-8d0f-4d8d-97c1-863f303090ea', 'serial': 'a87d5356-8d0f-4d8d-97c1-863f303090ea'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:16:41 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 20:16:41 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.objects.instance [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lazy-loading 'vcpu_model' on Instance uuid eb1a22c1-175e-480f-9ddf-cd297df993c8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHyCLGeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:16:41 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:16:41 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:16:41 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ca08dc-d6bf-48f3-a130-ca9654610674]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:16:41 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de52429-2889-49e1-89ef-ce180ffe5468]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea] added
Aug 17 20:16:41 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef62bbe4-3a8c-4c4e-93e9-58691092d465]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fe0c29-775c-4993-87a7-9b2760ec61e2]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHyCLGeo {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHyCLGeo" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[844f3a73-30b9-46ed-91b3-42ce45740a39]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iHyCLGeo'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[459db38a-1995-447f-b11e-8cc0bac8d52f]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[029946cd-57d8-43da-8548-4750784ca165]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:41 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:41 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:41 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:41 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:16:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:42 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:16:42 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Took 0.61 seconds to deallocate network for instance.
Aug 17 20:16:42 user nova-compute[72815]: DEBUG nova.compute.manager [req-b2b51031-2ff5-447d-bb4a-64c10163e52e req-c0f2758d-be5a-40bd-a61b-ea401d01faa9 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-deleted-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:42 user nova-compute[72815]: INFO nova.compute.manager [req-b2b51031-2ff5-447d-bb4a-64c10163e52e req-c0f2758d-be5a-40bd-a61b-ea401d01faa9 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Neutron deleted interface 7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe; detaching it from the instance and deleting it from the info cache
Aug 17 20:16:42 user nova-compute[72815]: DEBUG nova.network.neutron [req-b2b51031-2ff5-447d-bb4a-64c10163e52e req-c0f2758d-be5a-40bd-a61b-ea401d01faa9 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:16:42 user nova-compute[72815]: DEBUG nova.compute.manager [req-b2b51031-2ff5-447d-bb4a-64c10163e52e req-c0f2758d-be5a-40bd-a61b-ea401d01faa9 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Detach interface failed, port_id=7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe, reason: Instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:16:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:42 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:16:42 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:16:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:42 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Deleted allocations for instance dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2
Aug 17 20:16:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-74ab84a7-f547-4ee1-b260-5877d92b31c5 tempest-ServerRescueNegativeTestJSON-335799606 tempest-ServerRescueNegativeTestJSON-335799606-project-member] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.790s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --login" returned: 0 in 1.060s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:42 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3506bb29-568b-4bfa-a355-b86796e0786b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:42 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260]
Aug 17 20:16:42 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260] successful.
Aug 17 20:16:42 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9e5781-23ad-4759-962d-16d5a7972b13]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9325cc2b-92fb-4ed9-a4e6-317df5fd444a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:43 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:43 user nova-compute[72815]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:16:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:43 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:43 user nova-compute[72815]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:16:43 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.290s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3502014-e0ca-4f51-b326-28808ab40132]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHyCLGeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-18283a05-e66b-46ff-84ce-dbc661f522d2 req-f4666b1b-412e-4138-8047-f7e3280f8424 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-18283a05-e66b-46ff-84ce-dbc661f522d2 req-f4666b1b-412e-4138-8047-f7e3280f8424 service nova] Acquiring lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-18283a05-e66b-46ff-84ce-dbc661f522d2 req-f4666b1b-412e-4138-8047-f7e3280f8424 service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-18283a05-e66b-46ff-84ce-dbc661f522d2 req-f4666b1b-412e-4138-8047-f7e3280f8424 service nova] Lock "dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG nova.compute.manager [req-18283a05-e66b-46ff-84ce-dbc661f522d2 req-f4666b1b-412e-4138-8047-f7e3280f8424 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] No waiting events found dispatching network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:16:43 user nova-compute[72815]: WARNING nova.compute.manager [req-18283a05-e66b-46ff-84ce-dbc661f522d2 req-f4666b1b-412e-4138-8047-f7e3280f8424 service nova] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Received unexpected event network-vif-plugged-7f7d0039-07a8-4c0b-ae2c-6f87d3c08bbe for instance with vm_state deleted and task_state None.
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:16:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.objects.instance [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lazy-loading 'info_cache' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.333s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] <== connect_volume: return (2335ms) {'type': 'block', 'scsi_wwn': '26531323635383432', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531323635383432', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T20:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1731405860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1306781066',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT7QCi8nId/iu4W4vvmCjsuZSx5jxi+6/A/TppcD7spua4Voq9EKV3Cbyn1NISMYCmgMHcmF2qyJPdVxn7gfwy+H7ZUMeDJ7/t4NxqxTvVHfq3jjyoTa4Leb+MiNll4+g==',key_name='tempest-keypair-1418290547',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:14:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d85890dbab214814b52076eb232cac3f',ramdisk_id='',reservation_id='r-nkq44203',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-568249167',owner_user_name='tempest-ServerActionsV293TestJSON-568249167-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3fc7666dca14c5791054aa3cb89ebb3',uuid=eb1a22c1-175e-480f-9ddf-cd297df993c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Converting VIF {"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:16:44 user nova-compute[72815]:   <uuid>eb1a22c1-175e-480f-9ddf-cd297df993c8</uuid>
Aug 17 20:16:44 user nova-compute[72815]:   <name>instance-0000002b</name>
Aug 17 20:16:44 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:16:44 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:16:44 user nova-compute[72815]:   <metadata>
Aug 17 20:16:44 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:16:44 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:16:44 user nova-compute[72815]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1731405860</nova:name>
Aug 17 20:16:44 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:16:41</nova:creationTime>
Aug 17 20:16:44 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:16:44 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:16:44 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:16:44 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:16:44 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:16:44 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:16:44 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:16:44 user nova-compute[72815]:       <nova:owner>
Aug 17 20:16:44 user nova-compute[72815]:         <nova:user uuid="c3fc7666dca14c5791054aa3cb89ebb3">tempest-ServerActionsV293TestJSON-568249167-project-member</nova:user>
Aug 17 20:16:44 user nova-compute[72815]:         <nova:project uuid="d85890dbab214814b52076eb232cac3f">tempest-ServerActionsV293TestJSON-568249167</nova:project>
Aug 17 20:16:44 user nova-compute[72815]:       </nova:owner>
Aug 17 20:16:44 user nova-compute[72815]:       <nova:ports>
Aug 17 20:16:44 user nova-compute[72815]:         <nova:port uuid="9d809bd7-984f-4bdd-8d4c-76fbe05ec68c">
Aug 17 20:16:44 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 20:16:44 user nova-compute[72815]:         </nova:port>
Aug 17 20:16:44 user nova-compute[72815]:       </nova:ports>
Aug 17 20:16:44 user nova-compute[72815]:     </nova:instance>
Aug 17 20:16:44 user nova-compute[72815]:   </metadata>
Aug 17 20:16:44 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:16:44 user nova-compute[72815]:     <system>
Aug 17 20:16:44 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:16:44 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:16:44 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:16:44 user nova-compute[72815]:       <entry name="serial">eb1a22c1-175e-480f-9ddf-cd297df993c8</entry>
Aug 17 20:16:44 user nova-compute[72815]:       <entry name="uuid">eb1a22c1-175e-480f-9ddf-cd297df993c8</entry>
Aug 17 20:16:44 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:16:44 user nova-compute[72815]:     </system>
Aug 17 20:16:44 user nova-compute[72815]:   </sysinfo>
Aug 17 20:16:44 user nova-compute[72815]:   <os>
Aug 17 20:16:44 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:16:44 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:16:44 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:16:44 user nova-compute[72815]:   </os>
Aug 17 20:16:44 user nova-compute[72815]:   <features>
Aug 17 20:16:44 user nova-compute[72815]:     <acpi/>
Aug 17 20:16:44 user nova-compute[72815]:     <apic/>
Aug 17 20:16:44 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:16:44 user nova-compute[72815]:   </features>
Aug 17 20:16:44 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:16:44 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:16:44 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:16:44 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:16:44 user nova-compute[72815]:   </clock>
Aug 17 20:16:44 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:16:44 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:16:44 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:16:44 user nova-compute[72815]:   </cpu>
Aug 17 20:16:44 user nova-compute[72815]:   <devices>
Aug 17 20:16:44 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:16:44 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:16:44 user nova-compute[72815]:       <source dev="/dev/sdb"/>
Aug 17 20:16:44 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:16:44 user nova-compute[72815]:       <serial>a87d5356-8d0f-4d8d-97c1-863f303090ea</serial>
Aug 17 20:16:44 user nova-compute[72815]:     </disk>
Aug 17 20:16:44 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:16:44 user nova-compute[72815]:       <mac address="fa:16:3e:2b:26:1f"/>
Aug 17 20:16:44 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:16:44 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:16:44 user nova-compute[72815]:       <target dev="tap9d809bd7-98"/>
Aug 17 20:16:44 user nova-compute[72815]:     </interface>
Aug 17 20:16:44 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:16:44 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/eb1a22c1-175e-480f-9ddf-cd297df993c8/console.log" append="off"/>
Aug 17 20:16:44 user nova-compute[72815]:     </serial>
Aug 17 20:16:44 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:16:44 user nova-compute[72815]:     <video>
Aug 17 20:16:44 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:16:44 user nova-compute[72815]:     </video>
Aug 17 20:16:44 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:16:44 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:16:44 user nova-compute[72815]:     </rng>
Aug 17 20:16:44 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:16:44 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:16:44 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:16:44 user nova-compute[72815]:     </memballoon>
Aug 17 20:16:44 user nova-compute[72815]:   </devices>
Aug 17 20:16:44 user nova-compute[72815]: </domain>
Aug 17 20:16:44 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T20:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1731405860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1306781066',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT7QCi8nId/iu4W4vvmCjsuZSx5jxi+6/A/TppcD7spua4Voq9EKV3Cbyn1NISMYCmgMHcmF2qyJPdVxn7gfwy+H7ZUMeDJ7/t4NxqxTvVHfq3jjyoTa4Leb+MiNll4+g==',key_name='tempest-keypair-1418290547',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:14:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d85890dbab214814b52076eb232cac3f',ramdisk_id='',reservation_id='r-nkq44203',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-568249167',owner_user_name='tempest-ServerActionsV293TestJSON-568249167-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3fc7666dca14c5791054aa3cb89ebb3',uuid=eb1a22c1-175e-480f-9ddf-cd297df993c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Converting VIF {"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG os_vif [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d809bd7-98, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d809bd7-98, col_values=(('external_ids', {'iface-id': '9d809bd7-984f-4bdd-8d4c-76fbe05ec68c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:26:1f', 'vm-uuid': 'eb1a22c1-175e-480f-9ddf-cd297df993c8'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:44 user nova-compute[72815]: INFO os_vif [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98')
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] No VIF found with MAC fa:16:3e:2b:26:1f, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updating instance_info_cache with network_info: [{"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-99693a7e-71e3-4543-b649-41a147c77c7e" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:16:44 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:16:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:45 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:16:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-4bafb9c6-8250-404b-a283-864463642c1a req-c5bdc6bc-76a1-4aee-8d55-e4a6fd634e77 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4bafb9c6-8250-404b-a283-864463642c1a req-c5bdc6bc-76a1-4aee-8d55-e4a6fd634e77 service nova] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4bafb9c6-8250-404b-a283-864463642c1a req-c5bdc6bc-76a1-4aee-8d55-e4a6fd634e77 service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4bafb9c6-8250-404b-a283-864463642c1a req-c5bdc6bc-76a1-4aee-8d55-e4a6fd634e77 service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:45 user nova-compute[72815]: DEBUG nova.compute.manager [req-4bafb9c6-8250-404b-a283-864463642c1a req-c5bdc6bc-76a1-4aee-8d55-e4a6fd634e77 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] No waiting events found dispatching network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:16:45 user nova-compute[72815]: WARNING nova.compute.manager [req-4bafb9c6-8250-404b-a283-864463642c1a req-c5bdc6bc-76a1-4aee-8d55-e4a6fd634e77 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received unexpected event network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c for instance with vm_state active and task_state rebuild_spawning.
Aug 17 20:16:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:16:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303407.6422863, eb1a22c1-175e-480f-9ddf-cd297df993c8 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:16:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] VM Resumed (Lifecycle Event)
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:16:47 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Instance spawned successfully.
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:16:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303407.6437101, eb1a22c1-175e-480f-9ddf-cd297df993c8 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:16:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] VM Started (Lifecycle Event)
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:16:47 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 20:16:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG nova.objects.instance [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72815) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 20:16:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-25fab605-9955-46c2-800a-5e1352a9d34e tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.077s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-a38b71d5-9bad-419c-91d7-bee2937a7de5 req-eb370621-9bb9-41ae-861a-bbc1291bec21 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a38b71d5-9bad-419c-91d7-bee2937a7de5 req-eb370621-9bb9-41ae-861a-bbc1291bec21 service nova] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a38b71d5-9bad-419c-91d7-bee2937a7de5 req-eb370621-9bb9-41ae-861a-bbc1291bec21 service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a38b71d5-9bad-419c-91d7-bee2937a7de5 req-eb370621-9bb9-41ae-861a-bbc1291bec21 service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-a38b71d5-9bad-419c-91d7-bee2937a7de5 req-eb370621-9bb9-41ae-861a-bbc1291bec21 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] No waiting events found dispatching network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:16:48 user nova-compute[72815]: WARNING nova.compute.manager [req-a38b71d5-9bad-419c-91d7-bee2937a7de5 req-eb370621-9bb9-41ae-861a-bbc1291bec21 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received unexpected event network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c for instance with vm_state active and task_state None.
Aug 17 20:16:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:16:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:16:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-b9c1ae89-8125-4dd7-ac4d-26a88c07cdc3 req-a97e883c-9a8a-4346-9b87-82eea14d49de service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Received event network-changed-9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:54 user nova-compute[72815]: DEBUG nova.compute.manager [req-b9c1ae89-8125-4dd7-ac4d-26a88c07cdc3 req-a97e883c-9a8a-4346-9b87-82eea14d49de service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Refreshing instance network info cache due to event network-changed-9994e51b-d64f-4b64-8d37-421d34ee3b8e. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:16:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b9c1ae89-8125-4dd7-ac4d-26a88c07cdc3 req-a97e883c-9a8a-4346-9b87-82eea14d49de service nova] Acquiring lock "refresh_cache-c3a35887-4756-41ee-ba99-5b4e9fef7a80" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:16:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b9c1ae89-8125-4dd7-ac4d-26a88c07cdc3 req-a97e883c-9a8a-4346-9b87-82eea14d49de service nova] Acquired lock "refresh_cache-c3a35887-4756-41ee-ba99-5b4e9fef7a80" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:16:54 user nova-compute[72815]: DEBUG nova.network.neutron [req-b9c1ae89-8125-4dd7-ac4d-26a88c07cdc3 req-a97e883c-9a8a-4346-9b87-82eea14d49de service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Refreshing network info cache for port 9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:16:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:55 user nova-compute[72815]: INFO nova.compute.manager [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Terminating instance
Aug 17 20:16:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:16:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-b9c1ae89-8125-4dd7-ac4d-26a88c07cdc3 req-a97e883c-9a8a-4346-9b87-82eea14d49de service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Updated VIF entry in instance network info cache for port 9994e51b-d64f-4b64-8d37-421d34ee3b8e. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-b9c1ae89-8125-4dd7-ac4d-26a88c07cdc3 req-a97e883c-9a8a-4346-9b87-82eea14d49de service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Updating instance_info_cache with network_info: [{"id": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "address": "fa:16:3e:e4:f2:17", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9994e51b-d6", "ovs_interfaceid": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b9c1ae89-8125-4dd7-ac4d-26a88c07cdc3 req-a97e883c-9a8a-4346-9b87-82eea14d49de service nova] Releasing lock "refresh_cache-c3a35887-4756-41ee-ba99-5b4e9fef7a80" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:16:56 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Instance destroyed successfully.
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.objects.instance [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lazy-loading 'resources' on Instance uuid c3a35887-4756-41ee-ba99-5b4e9fef7a80 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-420576860',display_name='tempest-TestVolumeBootPattern-server-420576860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-420576860',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpfGoBrYuqmPWFRwR9dBH3etfjmi+9O1crWczyHc9MI1VhAR15OT7t+WrT1HrpsEV9/2nWGMdeUlL2wsj6uonqU5hD2QzwNh0c4wK0+zMM0byFWbIkK5vSFxWEBfwR78Q==',key_name='tempest-TestVolumeBootPattern-525261020',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:15:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-coobtyij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:15:19Z,user_data=None,user_id='577ed0692a254a2fbd518e258563447f',uuid=c3a35887-4756-41ee-ba99-5b4e9fef7a80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "address": "fa:16:3e:e4:f2:17", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9994e51b-d6", "ovs_interfaceid": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "address": "fa:16:3e:e4:f2:17", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9994e51b-d6", "ovs_interfaceid": "9994e51b-d64f-4b64-8d37-421d34ee3b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f2:17,bridge_name='br-int',has_traffic_filtering=True,id=9994e51b-d64f-4b64-8d37-421d34ee3b8e,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9994e51b-d6') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_vif [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f2:17,bridge_name='br-int',has_traffic_filtering=True,id=9994e51b-d64f-4b64-8d37-421d34ee3b8e,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9994e51b-d6') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9994e51b-d6, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:16:56 user nova-compute[72815]: INFO os_vif [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f2:17,bridge_name='br-int',has_traffic_filtering=True,id=9994e51b-d64f-4b64-8d37-421d34ee3b8e,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9994e51b-d6')
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yivEHohA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:16:56 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e0f280-71b8-42b6-bda4-d4c3d4b50f60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4db69c-8afb-4fcd-8292-82d801bd9cdd]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:56 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:56 user nova-compute[72815]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:16:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:16:56 user nova-compute[72815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:16:56 user nova-compute[72815]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:16:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944749d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27'): ({'sdc'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Removing single pathed devices sdc {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[653b0c87-a11b-4060-ba2a-e51ec4dc7fb9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac49a25c-9db7-4f6b-86fc-175c261f641d]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flushing IO for device /dev/sdc {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d59917b-c207-4729-9702-950637f9257c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7850df-422c-499e-9dce-ee6820979d95]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e7337b49',) {{(pid=84269) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1923636b-4106-4a77-98ab-a1cef3279c91]: (4, None) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd44e69-167a-452e-916a-99559fa4e54a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303401.4536476, dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:16:56 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] VM Stopped (Lifecycle Event)
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.compute.manager [None req-40a210e1-cd3e-41fa-9011-af3595754141 None None] [instance: dcd8a7a7-caae-4662-88d0-e1ac2e45c8b2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[76be92f9-f195-48dc-975e-b6e761d4140b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260]
Aug 17 20:16:56 user nova-compute[72815]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260] successful.
Aug 17 20:16:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea5059a-ee6b-4c2d-ac8f-73d9a745e51e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== disconnect_volume: return (387ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:16:56 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Deleting instance files /opt/stack/data/nova/instances/c3a35887-4756-41ee-ba99-5b4e9fef7a80_del
Aug 17 20:16:56 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Deletion of /opt/stack/data/nova/instances/c3a35887-4756-41ee-ba99-5b4e9fef7a80_del complete
Aug 17 20:16:56 user nova-compute[72815]: INFO nova.compute.manager [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-47c47915-f644-4785-a418-c4c68810efd1 req-659b5d89-9665-4d20-95d0-8e3e1b6bd8b0 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Received event network-vif-unplugged-9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47c47915-f644-4785-a418-c4c68810efd1 req-659b5d89-9665-4d20-95d0-8e3e1b6bd8b0 service nova] Acquiring lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47c47915-f644-4785-a418-c4c68810efd1 req-659b5d89-9665-4d20-95d0-8e3e1b6bd8b0 service nova] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47c47915-f644-4785-a418-c4c68810efd1 req-659b5d89-9665-4d20-95d0-8e3e1b6bd8b0 service nova] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-47c47915-f644-4785-a418-c4c68810efd1 req-659b5d89-9665-4d20-95d0-8e3e1b6bd8b0 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] No waiting events found dispatching network-vif-unplugged-9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-47c47915-f644-4785-a418-c4c68810efd1 req-659b5d89-9665-4d20-95d0-8e3e1b6bd8b0 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Received event network-vif-unplugged-9994e51b-d64f-4b64-8d37-421d34ee3b8e for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-47c47915-f644-4785-a418-c4c68810efd1 req-659b5d89-9665-4d20-95d0-8e3e1b6bd8b0 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Received event network-vif-plugged-9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47c47915-f644-4785-a418-c4c68810efd1 req-659b5d89-9665-4d20-95d0-8e3e1b6bd8b0 service nova] Acquiring lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47c47915-f644-4785-a418-c4c68810efd1 req-659b5d89-9665-4d20-95d0-8e3e1b6bd8b0 service nova] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-47c47915-f644-4785-a418-c4c68810efd1 req-659b5d89-9665-4d20-95d0-8e3e1b6bd8b0 service nova] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-47c47915-f644-4785-a418-c4c68810efd1 req-659b5d89-9665-4d20-95d0-8e3e1b6bd8b0 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] No waiting events found dispatching network-vif-plugged-9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:16:56 user nova-compute[72815]: WARNING nova.compute.manager [req-47c47915-f644-4785-a418-c4c68810efd1 req-659b5d89-9665-4d20-95d0-8e3e1b6bd8b0 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Received unexpected event network-vif-plugged-9994e51b-d64f-4b64-8d37-421d34ee3b8e for instance with vm_state active and task_state deleting.
Aug 17 20:16:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:58 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:16:58 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Took 1.59 seconds to deallocate network for instance.
Aug 17 20:16:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-475f3864-d478-4af9-b41c-e0b5cc17e095 req-fff30f9a-70d6-4908-bac9-ca2da321e740 service nova] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Received event network-vif-deleted-9994e51b-d64f-4b64-8d37-421d34ee3b8e {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:16:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:16:59 user nova-compute[72815]: INFO nova.compute.manager [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Took 0.80 seconds to detach 1 volumes for instance.
Aug 17 20:16:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:16:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:16:59 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:16:59 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:16:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:16:59 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Deleted allocations for instance c3a35887-4756-41ee-ba99-5b4e9fef7a80
Aug 17 20:16:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6bd03b-e373-42bc-bf98-53a4c4b80154 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "c3a35887-4756-41ee-ba99-5b4e9fef7a80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.264s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Acquiring lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:07 user nova-compute[72815]: DEBUG nova.compute.manager [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:17:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:07 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:17:07 user nova-compute[72815]: INFO nova.compute.claims [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Claim successful on node user
Aug 17 20:17:08 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG nova.compute.manager [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG nova.compute.manager [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:17:08 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:17:08 user nova-compute[72815]: DEBUG nova.compute.manager [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG nova.policy [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59da49ffd7f449dfad2626e0eb2d85bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb24b524a204e0da9cea0d4b784a827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG nova.compute.manager [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:17:08 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Creating image(s)
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Acquiring lock "/opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "/opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "/opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.206s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk 1073741824" returned: 0 in 0.134s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:08 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:09 user nova-compute[72815]: DEBUG nova.network.neutron [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Successfully created port: e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:17:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.231s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:09 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:17:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:09 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:09 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Cannot resize image /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:17:09 user nova-compute[72815]: DEBUG nova.objects.instance [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lazy-loading 'migration_context' on Instance uuid 34cd7ece-316a-419a-ab48-8f7dbfd7d78a {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:17:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:17:09 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Ensure instance console log exists: /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:17:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG nova.network.neutron [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Successfully updated port: e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Acquiring lock "refresh_cache-34cd7ece-316a-419a-ab48-8f7dbfd7d78a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Acquired lock "refresh_cache-34cd7ece-316a-419a-ab48-8f7dbfd7d78a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG nova.network.neutron [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-41336363-6680-4767-b5ef-e30b902343e6 req-fb8d52aa-db53-4aeb-b25a-76a6ea54b345 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Received event network-changed-5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-41336363-6680-4767-b5ef-e30b902343e6 req-fb8d52aa-db53-4aeb-b25a-76a6ea54b345 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Refreshing instance network info cache due to event network-changed-5eedb847-6aab-4b85-9e46-3ec250d0499c. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-41336363-6680-4767-b5ef-e30b902343e6 req-fb8d52aa-db53-4aeb-b25a-76a6ea54b345 service nova] Acquiring lock "refresh_cache-11d388da-9c0f-4ccf-8307-0cb7e1679fd2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-41336363-6680-4767-b5ef-e30b902343e6 req-fb8d52aa-db53-4aeb-b25a-76a6ea54b345 service nova] Acquired lock "refresh_cache-11d388da-9c0f-4ccf-8307-0cb7e1679fd2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-41336363-6680-4767-b5ef-e30b902343e6 req-fb8d52aa-db53-4aeb-b25a-76a6ea54b345 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Refreshing network info cache for port 5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-665dca6a-5fea-40a5-a3d3-eb43ae259425 req-e453800d-b696-4e48-834a-0c73768815ce service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Received event network-changed-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-665dca6a-5fea-40a5-a3d3-eb43ae259425 req-e453800d-b696-4e48-834a-0c73768815ce service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Refreshing instance network info cache due to event network-changed-e581f6a0-9e48-41d0-a2e5-e65f806e5b60. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-665dca6a-5fea-40a5-a3d3-eb43ae259425 req-e453800d-b696-4e48-834a-0c73768815ce service nova] Acquiring lock "refresh_cache-34cd7ece-316a-419a-ab48-8f7dbfd7d78a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG nova.network.neutron [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG nova.objects.instance [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lazy-loading 'flavor' on Instance uuid 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:17:10 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Ignoring supplied device name: /dev/vdb
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:10 user nova-compute[72815]: INFO nova.compute.manager [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Attaching volume 8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 to /dev/vdb
Aug 17 20:17:10 user nova-compute[72815]: DEBUG os_brick.utils [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-41336363-6680-4767-b5ef-e30b902343e6 req-fb8d52aa-db53-4aeb-b25a-76a6ea54b345 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Updated VIF entry in instance network info cache for port 5eedb847-6aab-4b85-9e46-3ec250d0499c. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG nova.network.neutron [req-41336363-6680-4767-b5ef-e30b902343e6 req-fb8d52aa-db53-4aeb-b25a-76a6ea54b345 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Updating instance_info_cache with network_info: [{"id": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "address": "fa:16:3e:f0:81:a4", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eedb847-6a", "ovs_interfaceid": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3749744-271d-436d-97de-c3b0f8835579]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-41336363-6680-4767-b5ef-e30b902343e6 req-fb8d52aa-db53-4aeb-b25a-76a6ea54b345 service nova] Releasing lock "refresh_cache-11d388da-9c0f-4ccf-8307-0cb7e1679fd2" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6525956-47a0-46ce-b581-61592371e29c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d2eeee-d656-48ce-b517-a458b86622e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6163e7d-6fa1-450b-bb35-c097bfd52d5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:17:10 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:17:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4304cde8-414e-4f61-acf8-f05c12524c6e]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG os_brick.utils [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:17:10 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Updating existing volume attachment record: 2babe79f-a78b-4018-b769-98a4565b2dfc {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.network.neutron [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Updating instance_info_cache with network_info: [{"id": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "address": "fa:16:3e:04:42:0c", "network": {"id": "286b5cca-939f-48af-a6b7-3ae07815935a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432746986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb24b524a204e0da9cea0d4b784a827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape581f6a0-9e", "ovs_interfaceid": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303416.1242747, c3a35887-4756-41ee-ba99-5b4e9fef7a80 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:17:11 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] VM Stopped (Lifecycle Event)
Aug 17 20:17:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Releasing lock "refresh_cache-34cd7ece-316a-419a-ab48-8f7dbfd7d78a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Instance network_info: |[{"id": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "address": "fa:16:3e:04:42:0c", "network": {"id": "286b5cca-939f-48af-a6b7-3ae07815935a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432746986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb24b524a204e0da9cea0d4b784a827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape581f6a0-9e", "ovs_interfaceid": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-665dca6a-5fea-40a5-a3d3-eb43ae259425 req-e453800d-b696-4e48-834a-0c73768815ce service nova] Acquired lock "refresh_cache-34cd7ece-316a-419a-ab48-8f7dbfd7d78a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.network.neutron [req-665dca6a-5fea-40a5-a3d3-eb43ae259425 req-e453800d-b696-4e48-834a-0c73768815ce service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Refreshing network info cache for port e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Start _get_guest_xml network_info=[{"id": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "address": "fa:16:3e:04:42:0c", "network": {"id": "286b5cca-939f-48af-a6b7-3ae07815935a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432746986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb24b524a204e0da9cea0d4b784a827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape581f6a0-9e", "ovs_interfaceid": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-def9e6d6-8f35-494d-8794-193da944f683 None None] [instance: c3a35887-4756-41ee-ba99-5b4e9fef7a80] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:17:11 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:17:11 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1275003686',display_name='tempest-VolumesActionsTest-instance-1275003686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1275003686',id=46,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edb24b524a204e0da9cea0d4b784a827',ramdisk_id='',reservation_id='r-zbo70sev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1897613823',owner_user_name='tempest-VolumesActionsTest-1897613823-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:17:08Z,user_data=None,user_id='59da49ffd7f449dfad2626e0eb2d85bf',uuid=34cd7ece-316a-419a-ab48-8f7dbfd7d78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "address": "fa:16:3e:04:42:0c", "network": {"id": "286b5cca-939f-48af-a6b7-3ae07815935a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432746986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb24b524a204e0da9cea0d4b784a827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape581f6a0-9e", "ovs_interfaceid": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Converting VIF {"id": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "address": "fa:16:3e:04:42:0c", "network": {"id": "286b5cca-939f-48af-a6b7-3ae07815935a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432746986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb24b524a204e0da9cea0d4b784a827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape581f6a0-9e", "ovs_interfaceid": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:42:0c,bridge_name='br-int',has_traffic_filtering=True,id=e581f6a0-9e48-41d0-a2e5-e65f806e5b60,network=Network(286b5cca-939f-48af-a6b7-3ae07815935a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape581f6a0-9e') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.objects.instance [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lazy-loading 'pci_devices' on Instance uuid 34cd7ece-316a-419a-ab48-8f7dbfd7d78a {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:17:11 user nova-compute[72815]:   <uuid>34cd7ece-316a-419a-ab48-8f7dbfd7d78a</uuid>
Aug 17 20:17:11 user nova-compute[72815]:   <name>instance-0000002e</name>
Aug 17 20:17:11 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:17:11 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:17:11 user nova-compute[72815]:   <metadata>
Aug 17 20:17:11 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:17:11 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:17:11 user nova-compute[72815]:       <nova:name>tempest-VolumesActionsTest-instance-1275003686</nova:name>
Aug 17 20:17:11 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:17:11</nova:creationTime>
Aug 17 20:17:11 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:17:11 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:17:11 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:17:11 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:17:11 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:17:11 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:17:11 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:17:11 user nova-compute[72815]:       <nova:owner>
Aug 17 20:17:11 user nova-compute[72815]:         <nova:user uuid="59da49ffd7f449dfad2626e0eb2d85bf">tempest-VolumesActionsTest-1897613823-project-member</nova:user>
Aug 17 20:17:11 user nova-compute[72815]:         <nova:project uuid="edb24b524a204e0da9cea0d4b784a827">tempest-VolumesActionsTest-1897613823</nova:project>
Aug 17 20:17:11 user nova-compute[72815]:       </nova:owner>
Aug 17 20:17:11 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:17:11 user nova-compute[72815]:       <nova:ports>
Aug 17 20:17:11 user nova-compute[72815]:         <nova:port uuid="e581f6a0-9e48-41d0-a2e5-e65f806e5b60">
Aug 17 20:17:11 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 20:17:11 user nova-compute[72815]:         </nova:port>
Aug 17 20:17:11 user nova-compute[72815]:       </nova:ports>
Aug 17 20:17:11 user nova-compute[72815]:     </nova:instance>
Aug 17 20:17:11 user nova-compute[72815]:   </metadata>
Aug 17 20:17:11 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:17:11 user nova-compute[72815]:     <system>
Aug 17 20:17:11 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:17:11 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:17:11 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:17:11 user nova-compute[72815]:       <entry name="serial">34cd7ece-316a-419a-ab48-8f7dbfd7d78a</entry>
Aug 17 20:17:11 user nova-compute[72815]:       <entry name="uuid">34cd7ece-316a-419a-ab48-8f7dbfd7d78a</entry>
Aug 17 20:17:11 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:17:11 user nova-compute[72815]:     </system>
Aug 17 20:17:11 user nova-compute[72815]:   </sysinfo>
Aug 17 20:17:11 user nova-compute[72815]:   <os>
Aug 17 20:17:11 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:17:11 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:17:11 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:17:11 user nova-compute[72815]:   </os>
Aug 17 20:17:11 user nova-compute[72815]:   <features>
Aug 17 20:17:11 user nova-compute[72815]:     <acpi/>
Aug 17 20:17:11 user nova-compute[72815]:     <apic/>
Aug 17 20:17:11 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:17:11 user nova-compute[72815]:   </features>
Aug 17 20:17:11 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:17:11 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:17:11 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:17:11 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:17:11 user nova-compute[72815]:   </clock>
Aug 17 20:17:11 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:17:11 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:17:11 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:17:11 user nova-compute[72815]:   </cpu>
Aug 17 20:17:11 user nova-compute[72815]:   <devices>
Aug 17 20:17:11 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:17:11 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:17:11 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk"/>
Aug 17 20:17:11 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:17:11 user nova-compute[72815]:     </disk>
Aug 17 20:17:11 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:17:11 user nova-compute[72815]:       <mac address="fa:16:3e:04:42:0c"/>
Aug 17 20:17:11 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:17:11 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:17:11 user nova-compute[72815]:       <target dev="tape581f6a0-9e"/>
Aug 17 20:17:11 user nova-compute[72815]:     </interface>
Aug 17 20:17:11 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:17:11 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/console.log" append="off"/>
Aug 17 20:17:11 user nova-compute[72815]:     </serial>
Aug 17 20:17:11 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:17:11 user nova-compute[72815]:     <video>
Aug 17 20:17:11 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:17:11 user nova-compute[72815]:     </video>
Aug 17 20:17:11 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:17:11 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:17:11 user nova-compute[72815]:     </rng>
Aug 17 20:17:11 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:17:11 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:17:11 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:17:11 user nova-compute[72815]:     </memballoon>
Aug 17 20:17:11 user nova-compute[72815]:   </devices>
Aug 17 20:17:11 user nova-compute[72815]: </domain>
Aug 17 20:17:11 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1275003686',display_name='tempest-VolumesActionsTest-instance-1275003686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1275003686',id=46,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edb24b524a204e0da9cea0d4b784a827',ramdisk_id='',reservation_id='r-zbo70sev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1897613823',owner_user_name='tempest-VolumesActionsTest-1897613823-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:17:08Z,user_data=None,user_id='59da49ffd7f449dfad2626e0eb2d85bf',uuid=34cd7ece-316a-419a-ab48-8f7dbfd7d78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "address": "fa:16:3e:04:42:0c", "network": {"id": "286b5cca-939f-48af-a6b7-3ae07815935a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432746986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb24b524a204e0da9cea0d4b784a827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape581f6a0-9e", "ovs_interfaceid": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Converting VIF {"id": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "address": "fa:16:3e:04:42:0c", "network": {"id": "286b5cca-939f-48af-a6b7-3ae07815935a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432746986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb24b524a204e0da9cea0d4b784a827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape581f6a0-9e", "ovs_interfaceid": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:42:0c,bridge_name='br-int',has_traffic_filtering=True,id=e581f6a0-9e48-41d0-a2e5-e65f806e5b60,network=Network(286b5cca-939f-48af-a6b7-3ae07815935a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape581f6a0-9e') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG os_vif [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:42:0c,bridge_name='br-int',has_traffic_filtering=True,id=e581f6a0-9e48-41d0-a2e5-e65f806e5b60,network=Network(286b5cca-939f-48af-a6b7-3ae07815935a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape581f6a0-9e') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape581f6a0-9e, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape581f6a0-9e, col_values=(('external_ids', {'iface-id': 'e581f6a0-9e48-41d0-a2e5-e65f806e5b60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:42:0c', 'vm-uuid': '34cd7ece-316a-419a-ab48-8f7dbfd7d78a'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:11 user nova-compute[72815]: INFO os_vif [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:42:0c,bridge_name='br-int',has_traffic_filtering=True,id=e581f6a0-9e48-41d0-a2e5-e65f806e5b60,network=Network(286b5cca-939f-48af-a6b7-3ae07815935a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape581f6a0-9e')
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] No VIF found with MAC fa:16:3e:04:42:0c, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.network.neutron [req-665dca6a-5fea-40a5-a3d3-eb43ae259425 req-e453800d-b696-4e48-834a-0c73768815ce service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Updated VIF entry in instance network info cache for port e581f6a0-9e48-41d0-a2e5-e65f806e5b60. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.network.neutron [req-665dca6a-5fea-40a5-a3d3-eb43ae259425 req-e453800d-b696-4e48-834a-0c73768815ce service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Updating instance_info_cache with network_info: [{"id": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "address": "fa:16:3e:04:42:0c", "network": {"id": "286b5cca-939f-48af-a6b7-3ae07815935a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432746986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb24b524a204e0da9cea0d4b784a827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape581f6a0-9e", "ovs_interfaceid": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-665dca6a-5fea-40a5-a3d3-eb43ae259425 req-e453800d-b696-4e48-834a-0c73768815ce service nova] Releasing lock "refresh_cache-34cd7ece-316a-419a-ab48-8f7dbfd7d78a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "37ce6156-441f-4e86-89c1-9a3b1590df47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:11 user nova-compute[72815]: INFO nova.compute.manager [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Terminating instance
Aug 17 20:17:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:17:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-f52d301d-6628-49b4-bd67-3227fd437b90 req-b1881c2e-5632-461d-9bd6-83bf5a27e1c8 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Received event network-vif-unplugged-36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f52d301d-6628-49b4-bd67-3227fd437b90 req-b1881c2e-5632-461d-9bd6-83bf5a27e1c8 service nova] Acquiring lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f52d301d-6628-49b4-bd67-3227fd437b90 req-b1881c2e-5632-461d-9bd6-83bf5a27e1c8 service nova] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f52d301d-6628-49b4-bd67-3227fd437b90 req-b1881c2e-5632-461d-9bd6-83bf5a27e1c8 service nova] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-f52d301d-6628-49b4-bd67-3227fd437b90 req-b1881c2e-5632-461d-9bd6-83bf5a27e1c8 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] No waiting events found dispatching network-vif-unplugged-36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:17:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-f52d301d-6628-49b4-bd67-3227fd437b90 req-b1881c2e-5632-461d-9bd6-83bf5a27e1c8 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Received event network-vif-unplugged-36bdea48-bb16-4017-9627-8c87a2fa6d13 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:17:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:13 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Instance destroyed successfully.
Aug 17 20:17:13 user nova-compute[72815]: DEBUG nova.objects.instance [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lazy-loading 'resources' on Instance uuid 37ce6156-441f-4e86-89c1-9a3b1590df47 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2042324172',display_name='tempest-AttachVolumeNegativeTest-server-2042324172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2042324172',id=42,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/vWM/347DvEF63SKo0JMPz8i1x2fjPhlD6nchXyYEweMGkGJJC4fxSFRWVxWAo6ikbB46MwlpdGDVQSG4fuds/aAXOLhAdsGMrYBAvoywhElRsBeVLLOu6sbkmoQ/1Pg==',key_name='tempest-keypair-1442516895',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:14:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ee9b4cae7404f3184fc480ffddfbbcd',ramdisk_id='',reservation_id='r-daktq2o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1950293532',owner_user_name='tempest-AttachVolumeNegativeTest-1950293532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:14:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a75e05392d54cfb9fcda786e3ee2efc',uuid=37ce6156-441f-4e86-89c1-9a3b1590df47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "address": "fa:16:3e:8b:a3:dc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36bdea48-bb", "ovs_interfaceid": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converting VIF {"id": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "address": "fa:16:3e:8b:a3:dc", "network": {"id": "6e0c7fbb-3223-4f15-aaf6-3bff728524dd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-375439872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b4cae7404f3184fc480ffddfbbcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36bdea48-bb", "ovs_interfaceid": "36bdea48-bb16-4017-9627-8c87a2fa6d13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:a3:dc,bridge_name='br-int',has_traffic_filtering=True,id=36bdea48-bb16-4017-9627-8c87a2fa6d13,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36bdea48-bb') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG os_vif [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:a3:dc,bridge_name='br-int',has_traffic_filtering=True,id=36bdea48-bb16-4017-9627-8c87a2fa6d13,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36bdea48-bb') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36bdea48-bb, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:13 user nova-compute[72815]: INFO os_vif [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:a3:dc,bridge_name='br-int',has_traffic_filtering=True,id=36bdea48-bb16-4017-9627-8c87a2fa6d13,network=Network(6e0c7fbb-3223-4f15-aaf6-3bff728524dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36bdea48-bb')
Aug 17 20:17:13 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Deleting instance files /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47_del
Aug 17 20:17:13 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Deletion of /opt/stack/data/nova/instances/37ce6156-441f-4e86-89c1-9a3b1590df47_del complete
Aug 17 20:17:13 user nova-compute[72815]: INFO nova.compute.manager [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 17 20:17:13 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-8fc3ecf4-5f1f-44c1-bd2b-5c6b973c31de req-95785135-de31-49b4-a1ff-9ec903089a08 service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Received event network-vif-plugged-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8fc3ecf4-5f1f-44c1-bd2b-5c6b973c31de req-95785135-de31-49b4-a1ff-9ec903089a08 service nova] Acquiring lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8fc3ecf4-5f1f-44c1-bd2b-5c6b973c31de req-95785135-de31-49b4-a1ff-9ec903089a08 service nova] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8fc3ecf4-5f1f-44c1-bd2b-5c6b973c31de req-95785135-de31-49b4-a1ff-9ec903089a08 service nova] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-8fc3ecf4-5f1f-44c1-bd2b-5c6b973c31de req-95785135-de31-49b4-a1ff-9ec903089a08 service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] No waiting events found dispatching network-vif-plugged-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:17:13 user nova-compute[72815]: WARNING nova.compute.manager [req-8fc3ecf4-5f1f-44c1-bd2b-5c6b973c31de req-95785135-de31-49b4-a1ff-9ec903089a08 service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Received unexpected event network-vif-plugged-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 for instance with vm_state building and task_state spawning.
Aug 17 20:17:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:14 user nova-compute[72815]: DEBUG nova.compute.manager [req-ddcfe6ce-47c9-4271-9042-35059f6e9dd3 req-76470599-f331-4d1d-ab05-cf88cd1a41c3 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Received event network-vif-plugged-36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ddcfe6ce-47c9-4271-9042-35059f6e9dd3 req-76470599-f331-4d1d-ab05-cf88cd1a41c3 service nova] Acquiring lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ddcfe6ce-47c9-4271-9042-35059f6e9dd3 req-76470599-f331-4d1d-ab05-cf88cd1a41c3 service nova] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ddcfe6ce-47c9-4271-9042-35059f6e9dd3 req-76470599-f331-4d1d-ab05-cf88cd1a41c3 service nova] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:14 user nova-compute[72815]: DEBUG nova.compute.manager [req-ddcfe6ce-47c9-4271-9042-35059f6e9dd3 req-76470599-f331-4d1d-ab05-cf88cd1a41c3 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] No waiting events found dispatching network-vif-plugged-36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:17:14 user nova-compute[72815]: WARNING nova.compute.manager [req-ddcfe6ce-47c9-4271-9042-35059f6e9dd3 req-76470599-f331-4d1d-ab05-cf88cd1a41c3 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Received unexpected event network-vif-plugged-36bdea48-bb16-4017-9627-8c87a2fa6d13 for instance with vm_state active and task_state deleting.
Aug 17 20:17:14 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:17:14 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Took 1.20 seconds to deallocate network for instance.
Aug 17 20:17:14 user nova-compute[72815]: DEBUG nova.compute.manager [req-94e96a97-9a86-4d3b-a211-c9eb2aaf4c83 req-30ca56d1-f189-48b8-9003-809bc64ec3b9 service nova] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Received event network-vif-deleted-36bdea48-bb16-4017-9627-8c87a2fa6d13 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:14 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:17:14 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:17:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:14 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Deleted allocations for instance 37ce6156-441f-4e86-89c1-9a3b1590df47
Aug 17 20:17:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb7692e1-f7e3-40c5-a618-bdac99aca567 tempest-AttachVolumeNegativeTest-1950293532 tempest-AttachVolumeNegativeTest-1950293532-project-member] Lock "37ce6156-441f-4e86-89c1-9a3b1590df47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.202s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303435.4704177, 34cd7ece-316a-419a-ab48-8f7dbfd7d78a => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:17:15 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] VM Resumed (Lifecycle Event)
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-d64fc32c-0cba-4486-ad30-9d1cbf6489c9 req-16c1df32-39e7-40f8-8be2-dcbc882f55ef service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Received event network-vif-plugged-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d64fc32c-0cba-4486-ad30-9d1cbf6489c9 req-16c1df32-39e7-40f8-8be2-dcbc882f55ef service nova] Acquiring lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d64fc32c-0cba-4486-ad30-9d1cbf6489c9 req-16c1df32-39e7-40f8-8be2-dcbc882f55ef service nova] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d64fc32c-0cba-4486-ad30-9d1cbf6489c9 req-16c1df32-39e7-40f8-8be2-dcbc882f55ef service nova] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.compute.manager [req-d64fc32c-0cba-4486-ad30-9d1cbf6489c9 req-16c1df32-39e7-40f8-8be2-dcbc882f55ef service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] No waiting events found dispatching network-vif-plugged-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:17:15 user nova-compute[72815]: WARNING nova.compute.manager [req-d64fc32c-0cba-4486-ad30-9d1cbf6489c9 req-16c1df32-39e7-40f8-8be2-dcbc882f55ef service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Received unexpected event network-vif-plugged-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 for instance with vm_state building and task_state spawning.
Aug 17 20:17:15 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Instance spawned successfully.
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:17:15 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303435.471631, 34cd7ece-316a-419a-ab48-8f7dbfd7d78a => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:17:15 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] VM Started (Lifecycle Event)
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:17:15 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:17:15 user nova-compute[72815]: INFO nova.compute.manager [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Took 7.22 seconds to spawn the instance on the hypervisor.
Aug 17 20:17:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:17:15 user nova-compute[72815]: INFO nova.compute.manager [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Took 7.93 seconds to build instance.
Aug 17 20:17:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-becfe0a3-a4eb-44a0-b078-fa161c671213 tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.056s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:22 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:17:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcZOhGzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:17:22 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:17:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:17:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:17:22 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:17:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:17:22 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:17:22 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:17:22 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaa69f0-c8c9-46af-9938-47c0cf9101c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:17:23 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fc646e-f074-4d44-a5d5-a6e2a6556885]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3] added
Aug 17 20:17:23 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0dae48-6c1f-461e-a894-398b8d22c67d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b18e396-24ec-416c-bf93-79fa5f64832c]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcZOhGzU {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcZOhGzU" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43eb954-c72f-4d62-b9b4-23341f881c37]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcZOhGzU'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.066s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[23be7b70-ab83-49ea-906e-cbc3025c79d2]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72df7772-6e80-4863-9c4d-5f0fd69454f0]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:17:23 user nova-compute[72815]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:17:23 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:17:23 user nova-compute[72815]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:17:23 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8799eaa-ec00-4ae5-9a27-7dc5aea3b942]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3, portal: 172.16.0.220,3260]
Aug 17 20:17:23 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3, portal: 172.16.0.220,3260] successful.
Aug 17 20:17:23 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[861c2192-ad20-4fc7-8ef5-8530dfb1f511]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5106178c-3514-4344-b848-b823de1779df]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:17:23 user nova-compute[72815]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:17:23 user nova-compute[72815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)
Aug 17 20:17:23 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:17:23 user nova-compute[72815]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:17:23 user nova-compute[72815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)
Aug 17 20:17:23 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[942b3022-1da2-4592-b26a-d45ec4eff137]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:17:23 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcZOhGzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:17:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:17:24 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23333336239633665', 'path': '/dev/sdc'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:17:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333336239633665', 'path': '/dev/sdc'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:17:24 user nova-compute[72815]: DEBUG nova.objects.instance [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lazy-loading 'flavor' on Instance uuid 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:17:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:17:24 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:17:24 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 20:17:24 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:17:24 user nova-compute[72815]:   <serial>8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3</serial>
Aug 17 20:17:24 user nova-compute[72815]: </disk>
Aug 17 20:17:24 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:17:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:17:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:17:24 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] No VIF found with MAC fa:16:3e:f0:81:a4, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:17:25 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-217f5ff4-3f3f-493a-84a5-b9df6c94e68b tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.355s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:28 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303433.1497943, 37ce6156-441f-4e86-89c1-9a3b1590df47 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:17:28 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] VM Stopped (Lifecycle Event)
Aug 17 20:17:28 user nova-compute[72815]: DEBUG nova.compute.manager [None req-211c4e17-78dc-4da1-ab26-7257bc51873b None None] [instance: 37ce6156-441f-4e86-89c1-9a3b1590df47] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:17:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:35 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:17:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:35 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:35 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:17:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:36 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:17:36 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:17:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:17:38 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:17:38 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:17:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=25.32177734375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 99693a7e-71e3-4543-b649-41a147c77c7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 0145191d-46b5-458c-9e04-136bd4635d40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance eb1a22c1-175e-480f-9ddf-cd297df993c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 34cd7ece-316a-419a-ab48-8f7dbfd7d78a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:17:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:17:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:17:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:17:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:44 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:17:45 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:17:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:17:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:17:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:17:46 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:17:46 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updating instance_info_cache with network_info: [{"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:17:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:17:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-a54aab10-98ae-492b-a959-ef266f68231b req-71563d85-e224-4198-80f8-8612bf8d748a service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-changed-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-a54aab10-98ae-492b-a959-ef266f68231b req-71563d85-e224-4198-80f8-8612bf8d748a service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Refreshing instance network info cache due to event network-changed-331a772e-61c5-4bbe-920e-f37642d7e012. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a54aab10-98ae-492b-a959-ef266f68231b req-71563d85-e224-4198-80f8-8612bf8d748a service nova] Acquiring lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a54aab10-98ae-492b-a959-ef266f68231b req-71563d85-e224-4198-80f8-8612bf8d748a service nova] Acquired lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG nova.network.neutron [req-a54aab10-98ae-492b-a959-ef266f68231b req-71563d85-e224-4198-80f8-8612bf8d748a service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Refreshing network info cache for port 331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG nova.network.neutron [req-a54aab10-98ae-492b-a959-ef266f68231b req-71563d85-e224-4198-80f8-8612bf8d748a service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updated VIF entry in instance network info cache for port 331a772e-61c5-4bbe-920e-f37642d7e012. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG nova.network.neutron [req-a54aab10-98ae-492b-a959-ef266f68231b req-71563d85-e224-4198-80f8-8612bf8d748a service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updating instance_info_cache with network_info: [{"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a54aab10-98ae-492b-a959-ef266f68231b req-71563d85-e224-4198-80f8-8612bf8d748a service nova] Releasing lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "48168dd3-a054-49e9-af8e-3d373378f87a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "48168dd3-a054-49e9-af8e-3d373378f87a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:17:47 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:17:47 user nova-compute[72815]: INFO nova.compute.claims [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Claim successful on node user
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:17:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-ba4b9e70-48f4-4265-bd92-878412b57c6d req-f43cafc5-acb3-47ca-b9d0-93995d88a740 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-changed-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-ba4b9e70-48f4-4265-bd92-878412b57c6d req-f43cafc5-acb3-47ca-b9d0-93995d88a740 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Refreshing instance network info cache due to event network-changed-331a772e-61c5-4bbe-920e-f37642d7e012. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ba4b9e70-48f4-4265-bd92-878412b57c6d req-f43cafc5-acb3-47ca-b9d0-93995d88a740 service nova] Acquiring lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ba4b9e70-48f4-4265-bd92-878412b57c6d req-f43cafc5-acb3-47ca-b9d0-93995d88a740 service nova] Acquired lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.network.neutron [req-ba4b9e70-48f4-4265-bd92-878412b57c6d req-f43cafc5-acb3-47ca-b9d0-93995d88a740 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Refreshing network info cache for port 331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:17:48 user nova-compute[72815]: INFO nova.virt.block_device [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Booting with volume 6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 at /dev/vda
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.policy [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '577ed0692a254a2fbd518e258563447f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78ad2cbee8e4db892ab66d619e0e42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG os_brick.utils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffbf952-820c-4bd5-b36c-595630b6c235]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9aecbf-ae1d-44b4-a072-f9dee38bac2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:48 user nova-compute[72815]: INFO nova.compute.manager [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Detaching volume a479307e-e873-4e7a-bde9-d2d235f6201d
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e938eaac-abd4-4c83-ab1d-a09052036348]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8ad8ee-d49a-4600-af4e-1497d2e5ba16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:17:48 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e1f26f-0b17-435d-b8d4-7720d856e441]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG os_brick.utils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updating existing volume attachment record: 6e8f941a-77e8-4c5a-b00a-c760d523b9d4 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:17:48 user nova-compute[72815]: INFO nova.virt.block_device [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Attempting to driver detach volume a479307e-e873-4e7a-bde9-d2d235f6201d from mountpoint /dev/vdb
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Attempting to detach device vdb from instance 0145191d-46b5-458c-9e04-136bd4635d40 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:17:48 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:17:48 user nova-compute[72815]:   <source dev="/dev/sdd"/>
Aug 17 20:17:48 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:17:48 user nova-compute[72815]:   <serial>a479307e-e873-4e7a-bde9-d2d235f6201d</serial>
Aug 17 20:17:48 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 20:17:48 user nova-compute[72815]: </disk>
Aug 17 20:17:48 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:17:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Successfully detached device vdb from instance 0145191d-46b5-458c-9e04-136bd4635d40 from the persistent domain config.
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0145191d-46b5-458c-9e04-136bd4635d40 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:17:48 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:17:48 user nova-compute[72815]:   <source dev="/dev/sdd"/>
Aug 17 20:17:48 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:17:48 user nova-compute[72815]:   <serial>a479307e-e873-4e7a-bde9-d2d235f6201d</serial>
Aug 17 20:17:48 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 20:17:48 user nova-compute[72815]: </disk>
Aug 17 20:17:48 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.network.neutron [req-ba4b9e70-48f4-4265-bd92-878412b57c6d req-f43cafc5-acb3-47ca-b9d0-93995d88a740 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updated VIF entry in instance network info cache for port 331a772e-61c5-4bbe-920e-f37642d7e012. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG nova.network.neutron [req-ba4b9e70-48f4-4265-bd92-878412b57c6d req-f43cafc5-acb3-47ca-b9d0-93995d88a740 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updating instance_info_cache with network_info: [{"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:17:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ba4b9e70-48f4-4265-bd92-878412b57c6d req-f43cafc5-acb3-47ca-b9d0-93995d88a740 service nova] Releasing lock "refresh_cache-0145191d-46b5-458c-9e04-136bd4635d40" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Successfully created port: 1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692303469.2988505, 0145191d-46b5-458c-9e04-136bd4635d40 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0145191d-46b5-458c-9e04-136bd4635d40 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:17:49 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Successfully detached device vdb from instance 0145191d-46b5-458c-9e04-136bd4635d40 from the live domain config.
Aug 17 20:17:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLMCXWtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:17:49 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cc00a4-0e36-44c2-8078-de633ad66eae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62dd609-8353-4249-88db-f807c699a534]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:17:49 user nova-compute[72815]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:17:49 user nova-compute[72815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)
Aug 17 20:17:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d (non-flash)
Aug 17 20:17:49 user nova-compute[72815]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:17:49 user nova-compute[72815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)
Aug 17 20:17:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944752d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d'): ({'sdd'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Removing single pathed devices sdd {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3d906e-4679-4fb4-98ba-fea3643fde37]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b38478-a4fc-4669-8409-d52afc866061]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Flushing IO for device /dev/sdd {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c43aaaf-2676-44f7-8992-071133c53882]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0a4cef-cabb-4f7a-b5d8-bb5efa56d54d]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] SCSI volumes sdd have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53bbd55-b653-42f4-a002-f8aec7840565]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdbf4cb-bf43-47d3-b52e-bebe316e95b6]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260]
Aug 17 20:17:49 user nova-compute[72815]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d, portal: 172.16.0.220,3260] successful.
Aug 17 20:17:49 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479307e-e873-4e7a-bde9-d2d235f6201d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a96429c-fdcb-4ef8-a54d-0aaa62abf6bb]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] <== disconnect_volume: return (307ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:17:49 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Successfully updated port: 1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquired lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-929a7f2c-1a38-4ab1-b13d-9159a1b7fd07 req-0bc784cf-e3ba-4cb6-8e77-4a943b5d04da service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-changed-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-929a7f2c-1a38-4ab1-b13d-9159a1b7fd07 req-0bc784cf-e3ba-4cb6-8e77-4a943b5d04da service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Refreshing instance network info cache due to event network-changed-1645a7ee-c867-417f-b297-2122fd346fc4. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-929a7f2c-1a38-4ab1-b13d-9159a1b7fd07 req-0bc784cf-e3ba-4cb6-8e77-4a943b5d04da service nova] Acquiring lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG nova.objects.instance [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'flavor' on Instance uuid 0145191d-46b5-458c-9e04-136bd4635d40 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-6c89c3d1-aa05-48b9-bb42-7b47350ee0ce tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.096s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updating instance_info_cache with network_info: [{"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Releasing lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Instance network_info: |[{"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-929a7f2c-1a38-4ab1-b13d-9159a1b7fd07 req-0bc784cf-e3ba-4cb6-8e77-4a943b5d04da service nova] Acquired lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-929a7f2c-1a38-4ab1-b13d-9159a1b7fd07 req-0bc784cf-e3ba-4cb6-8e77-4a943b5d04da service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Refreshing network info cache for port 1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:17:50 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:17:51 user nova-compute[72815]: DEBUG nova.network.neutron [req-929a7f2c-1a38-4ab1-b13d-9159a1b7fd07 req-0bc784cf-e3ba-4cb6-8e77-4a943b5d04da service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updated VIF entry in instance network info cache for port 1645a7ee-c867-417f-b297-2122fd346fc4. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:17:51 user nova-compute[72815]: DEBUG nova.network.neutron [req-929a7f2c-1a38-4ab1-b13d-9159a1b7fd07 req-0bc784cf-e3ba-4cb6-8e77-4a943b5d04da service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updating instance_info_cache with network_info: [{"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:17:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-929a7f2c-1a38-4ab1-b13d-9159a1b7fd07 req-0bc784cf-e3ba-4cb6-8e77-4a943b5d04da service nova] Releasing lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:17:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:55 user nova-compute[72815]: INFO nova.compute.manager [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Terminating instance
Aug 17 20:17:55 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:17:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-0afb91fa-d333-470a-a6eb-b5c4991ff053 req-05f2c973-a0ae-4157-bd54-ece15ed7907c service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event network-vif-unplugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0afb91fa-d333-470a-a6eb-b5c4991ff053 req-05f2c973-a0ae-4157-bd54-ece15ed7907c service nova] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0afb91fa-d333-470a-a6eb-b5c4991ff053 req-05f2c973-a0ae-4157-bd54-ece15ed7907c service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-0afb91fa-d333-470a-a6eb-b5c4991ff053 req-05f2c973-a0ae-4157-bd54-ece15ed7907c service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-0afb91fa-d333-470a-a6eb-b5c4991ff053 req-05f2c973-a0ae-4157-bd54-ece15ed7907c service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] No waiting events found dispatching network-vif-unplugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-0afb91fa-d333-470a-a6eb-b5c4991ff053 req-05f2c973-a0ae-4157-bd54-ece15ed7907c service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event network-vif-unplugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:17:56 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Instance destroyed successfully.
Aug 17 20:17:56 user nova-compute[72815]: DEBUG nova.objects.instance [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lazy-loading 'resources' on Instance uuid eb1a22c1-175e-480f-9ddf-cd297df993c8 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T20:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1731405860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1306781066',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT7QCi8nId/iu4W4vvmCjsuZSx5jxi+6/A/TppcD7spua4Voq9EKV3Cbyn1NISMYCmgMHcmF2qyJPdVxn7gfwy+H7ZUMeDJ7/t4NxqxTvVHfq3jjyoTa4Leb+MiNll4+g==',key_name='tempest-keypair-1418290547',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:16:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d85890dbab214814b52076eb232cac3f',ramdisk_id='',reservation_id='r-nkq44203',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-568249167',owner_user_name='tempest-ServerActionsV293TestJSON-568249167-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3fc7666dca14c5791054aa3cb89ebb3',uuid=eb1a22c1-175e-480f-9ddf-cd297df993c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Converting VIF {"id": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "address": "fa:16:3e:2b:26:1f", "network": {"id": "3062b146-7581-471d-ad2a-82ec11de9d9f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1614387294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d85890dbab214814b52076eb232cac3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d809bd7-98", "ovs_interfaceid": "9d809bd7-984f-4bdd-8d4c-76fbe05ec68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_vif [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d809bd7-98, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:17:56 user nova-compute[72815]: INFO os_vif [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:1f,bridge_name='br-int',has_traffic_filtering=True,id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c,network=Network(3062b146-7581-471d-ad2a-82ec11de9d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d809bd7-98')
Aug 17 20:17:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHyCLGeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:17:56 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4b13b6-2fdb-4f41-9dca-3594e4b1029e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25c44f8-cc04-479b-8da8-99a55ba84a37]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:17:56 user nova-compute[72815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)
Aug 17 20:17:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea (non-flash)
Aug 17 20:17:56 user nova-compute[72815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)
Aug 17 20:17:56 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994456830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea'): ({'sdb'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Removing single pathed devices sdb {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad8b493-ccf1-4f8f-a385-366e002f8af8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[905e672b-7cad-469b-8956-a8efb9683d61]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Flushing IO for device /dev/sdb {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae75322-1edc-4b2e-8191-d54bf3fb2937]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fdcdc8-6819-4e45-86d9-d24332ff9f8d]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc94a70-bf36-456e-843a-5638443db68a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1d84db-09ee-4036-8dc4-6d6fe820110e]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260]
Aug 17 20:17:57 user nova-compute[72815]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea, portal: 172.16.0.220,3260] successful.
Aug 17 20:17:57 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87d5356-8d0f-4d8d-97c1-863f303090ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f423e06e-f0cd-4340-8b89-bb2febbba84e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] <== disconnect_volume: return (330ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:17:57 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Deleting instance files /opt/stack/data/nova/instances/eb1a22c1-175e-480f-9ddf-cd297df993c8_del
Aug 17 20:17:57 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Deletion of /opt/stack/data/nova/instances/eb1a22c1-175e-480f-9ddf-cd297df993c8_del complete
Aug 17 20:17:57 user nova-compute[72815]: INFO nova.compute.manager [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 17 20:17:57 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:17:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:17:58 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:17:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-0b1fb498-5499-4580-a554-41255cc17c3d req-cb2efb5c-cbd8-4559-85ce-7ea829417fc0 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event network-vif-deleted-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:58 user nova-compute[72815]: INFO nova.compute.manager [req-0b1fb498-5499-4580-a554-41255cc17c3d req-cb2efb5c-cbd8-4559-85ce-7ea829417fc0 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Neutron deleted interface 9d809bd7-984f-4bdd-8d4c-76fbe05ec68c; detaching it from the instance and deleting it from the info cache
Aug 17 20:17:58 user nova-compute[72815]: DEBUG nova.network.neutron [req-0b1fb498-5499-4580-a554-41255cc17c3d req-cb2efb5c-cbd8-4559-85ce-7ea829417fc0 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:17:58 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Took 0.90 seconds to deallocate network for instance.
Aug 17 20:17:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-0b1fb498-5499-4580-a554-41255cc17c3d req-cb2efb5c-cbd8-4559-85ce-7ea829417fc0 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Detach interface failed, port_id=9d809bd7-984f-4bdd-8d4c-76fbe05ec68c, reason: Instance eb1a22c1-175e-480f-9ddf-cd297df993c8 could not be found. {{(pid=72815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 20:17:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e21e806-bcb4-423e-9d64-a599df1368b6 req-6d10fe00-75de-4587-ad78-bf0e8f39b7a3 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received event network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:17:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e21e806-bcb4-423e-9d64-a599df1368b6 req-6d10fe00-75de-4587-ad78-bf0e8f39b7a3 service nova] Acquiring lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e21e806-bcb4-423e-9d64-a599df1368b6 req-6d10fe00-75de-4587-ad78-bf0e8f39b7a3 service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2e21e806-bcb4-423e-9d64-a599df1368b6 req-6d10fe00-75de-4587-ad78-bf0e8f39b7a3 service nova] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:58 user nova-compute[72815]: DEBUG nova.compute.manager [req-2e21e806-bcb4-423e-9d64-a599df1368b6 req-6d10fe00-75de-4587-ad78-bf0e8f39b7a3 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] No waiting events found dispatching network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:17:58 user nova-compute[72815]: WARNING nova.compute.manager [req-2e21e806-bcb4-423e-9d64-a599df1368b6 req-6d10fe00-75de-4587-ad78-bf0e8f39b7a3 service nova] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Received unexpected event network-vif-plugged-9d809bd7-984f-4bdd-8d4c-76fbe05ec68c for instance with vm_state active and task_state deleting.
Aug 17 20:17:58 user nova-compute[72815]: INFO nova.compute.manager [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Took 0.88 seconds to detach 1 volumes for instance.
Aug 17 20:17:58 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Deleting volume: a87d5356-8d0f-4d8d-97c1-863f303090ea {{(pid=72815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 20:17:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:17:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:17:59 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:17:59 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:17:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:17:59 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Deleted allocations for instance eb1a22c1-175e-480f-9ddf-cd297df993c8
Aug 17 20:17:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d13f4031-eb54-416b-af52-2e44450a5656 tempest-ServerActionsV293TestJSON-568249167 tempest-ServerActionsV293TestJSON-568249167-project-member] Lock "eb1a22c1-175e-480f-9ddf-cd297df993c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.574s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:18:00 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Creating image(s)
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Did not create local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Ensure instance console log exists: /opt/stack/data/nova/instances/48168dd3-a054-49e9-af8e-3d373378f87a/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Start _get_guest_xml network_info=[{"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '6e8f941a-77e8-4c5a-b00a-c760d523b9d4', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yivEHohA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48168dd3-a054-49e9-af8e-3d373378f87a', 'attached_at': '', 'detached_at': '', 'volume_id': '6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27', 'serial': '6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:18:00 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:18:00 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yivEHohA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:18:00 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:18:00 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:18:00 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8478d912-b426-42dd-8eee-778ec555eaac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:18:00 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c6c3ed-da95-440e-97c9-1b22bd59f867]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27] added
Aug 17 20:18:00 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.127s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b03963-07da-4abe-a20a-14b2119d3a5e]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b4ec23-b633-435f-9cf3-7e74afcb88fb]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yivEHohA {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yivEHohA" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4dc315-9021-4d51-9346-56150312b1fa]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yivEHohA'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e4edb9-2c4f-430e-a60d-b54f0397b90d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b8eb66-2eed-4e2c-87b3-247cd8c24ba3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)
Aug 17 20:18:00 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)
Aug 17 20:18:00 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b78a1-21d4-422e-8cd9-146e972ec296]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260]
Aug 17 20:18:00 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260] successful.
Aug 17 20:18:00 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadb7b05-0cb0-43e5-b7d5-5dfb3d66b9b8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1402a5-1ef8-42d0-8b95-db99828fda75]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)
Aug 17 20:18:00 user nova-compute[72815]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:18:00 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)
Aug 17 20:18:00 user nova-compute[72815]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:18:00 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c03fb0-6a4c-4d23-8011-ca898dcc3143]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:00 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yivEHohA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23966353663663731', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966353663663731', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-484348863',display_name='tempest-TestVolumeBootPattern-server-484348863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-484348863',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpfGoBrYuqmPWFRwR9dBH3etfjmi+9O1crWczyHc9MI1VhAR15OT7t+WrT1HrpsEV9/2nWGMdeUlL2wsj6uonqU5hD2QzwNh0c4wK0+zMM0byFWbIkK5vSFxWEBfwR78Q==',key_name='tempest-TestVolumeBootPattern-525261020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-q2x08e7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:17:48Z,user_data=None,user_id='577ed0692a254a2fbd518e258563447f',uuid=48168dd3-a054-49e9-af8e-3d373378f87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:ed:2b,bridge_name='br-int',has_traffic_filtering=True,id=1645a7ee-c867-417f-b297-2122fd346fc4,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1645a7ee-c8') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG nova.objects.instance [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lazy-loading 'pci_devices' on Instance uuid 48168dd3-a054-49e9-af8e-3d373378f87a {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:18:01 user nova-compute[72815]:   <uuid>48168dd3-a054-49e9-af8e-3d373378f87a</uuid>
Aug 17 20:18:01 user nova-compute[72815]:   <name>instance-0000002f</name>
Aug 17 20:18:01 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:18:01 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:18:01 user nova-compute[72815]:   <metadata>
Aug 17 20:18:01 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:18:01 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:18:01 user nova-compute[72815]:       <nova:name>tempest-TestVolumeBootPattern-server-484348863</nova:name>
Aug 17 20:18:01 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:18:00</nova:creationTime>
Aug 17 20:18:01 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:18:01 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:18:01 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:18:01 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:18:01 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:18:01 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:18:01 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:18:01 user nova-compute[72815]:       <nova:owner>
Aug 17 20:18:01 user nova-compute[72815]:         <nova:user uuid="577ed0692a254a2fbd518e258563447f">tempest-TestVolumeBootPattern-781314261-project-member</nova:user>
Aug 17 20:18:01 user nova-compute[72815]:         <nova:project uuid="a78ad2cbee8e4db892ab66d619e0e42e">tempest-TestVolumeBootPattern-781314261</nova:project>
Aug 17 20:18:01 user nova-compute[72815]:       </nova:owner>
Aug 17 20:18:01 user nova-compute[72815]:       <nova:ports>
Aug 17 20:18:01 user nova-compute[72815]:         <nova:port uuid="1645a7ee-c867-417f-b297-2122fd346fc4">
Aug 17 20:18:01 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 20:18:01 user nova-compute[72815]:         </nova:port>
Aug 17 20:18:01 user nova-compute[72815]:       </nova:ports>
Aug 17 20:18:01 user nova-compute[72815]:     </nova:instance>
Aug 17 20:18:01 user nova-compute[72815]:   </metadata>
Aug 17 20:18:01 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:18:01 user nova-compute[72815]:     <system>
Aug 17 20:18:01 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:18:01 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:18:01 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:18:01 user nova-compute[72815]:       <entry name="serial">48168dd3-a054-49e9-af8e-3d373378f87a</entry>
Aug 17 20:18:01 user nova-compute[72815]:       <entry name="uuid">48168dd3-a054-49e9-af8e-3d373378f87a</entry>
Aug 17 20:18:01 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:18:01 user nova-compute[72815]:     </system>
Aug 17 20:18:01 user nova-compute[72815]:   </sysinfo>
Aug 17 20:18:01 user nova-compute[72815]:   <os>
Aug 17 20:18:01 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:18:01 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:18:01 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:18:01 user nova-compute[72815]:   </os>
Aug 17 20:18:01 user nova-compute[72815]:   <features>
Aug 17 20:18:01 user nova-compute[72815]:     <acpi/>
Aug 17 20:18:01 user nova-compute[72815]:     <apic/>
Aug 17 20:18:01 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:18:01 user nova-compute[72815]:   </features>
Aug 17 20:18:01 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:18:01 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:18:01 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:18:01 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:18:01 user nova-compute[72815]:   </clock>
Aug 17 20:18:01 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:18:01 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:18:01 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:18:01 user nova-compute[72815]:   </cpu>
Aug 17 20:18:01 user nova-compute[72815]:   <devices>
Aug 17 20:18:01 user nova-compute[72815]:     <disk type="block" device="disk">
Aug 17 20:18:01 user nova-compute[72815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:18:01 user nova-compute[72815]:       <source dev="/dev/sdb"/>
Aug 17 20:18:01 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:18:01 user nova-compute[72815]:       <serial>6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27</serial>
Aug 17 20:18:01 user nova-compute[72815]:     </disk>
Aug 17 20:18:01 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:18:01 user nova-compute[72815]:       <mac address="fa:16:3e:52:ed:2b"/>
Aug 17 20:18:01 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:18:01 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:18:01 user nova-compute[72815]:       <target dev="tap1645a7ee-c8"/>
Aug 17 20:18:01 user nova-compute[72815]:     </interface>
Aug 17 20:18:01 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:18:01 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/48168dd3-a054-49e9-af8e-3d373378f87a/console.log" append="off"/>
Aug 17 20:18:01 user nova-compute[72815]:     </serial>
Aug 17 20:18:01 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:18:01 user nova-compute[72815]:     <video>
Aug 17 20:18:01 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:18:01 user nova-compute[72815]:     </video>
Aug 17 20:18:01 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:18:01 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:18:01 user nova-compute[72815]:     </rng>
Aug 17 20:18:01 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:18:01 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:18:01 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:18:01 user nova-compute[72815]:     </memballoon>
Aug 17 20:18:01 user nova-compute[72815]:   </devices>
Aug 17 20:18:01 user nova-compute[72815]: </domain>
Aug 17 20:18:01 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-484348863',display_name='tempest-TestVolumeBootPattern-server-484348863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-484348863',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpfGoBrYuqmPWFRwR9dBH3etfjmi+9O1crWczyHc9MI1VhAR15OT7t+WrT1HrpsEV9/2nWGMdeUlL2wsj6uonqU5hD2QzwNh0c4wK0+zMM0byFWbIkK5vSFxWEBfwR78Q==',key_name='tempest-TestVolumeBootPattern-525261020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-q2x08e7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:17:48Z,user_data=None,user_id='577ed0692a254a2fbd518e258563447f',uuid=48168dd3-a054-49e9-af8e-3d373378f87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:ed:2b,bridge_name='br-int',has_traffic_filtering=True,id=1645a7ee-c867-417f-b297-2122fd346fc4,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1645a7ee-c8') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG os_vif [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:ed:2b,bridge_name='br-int',has_traffic_filtering=True,id=1645a7ee-c867-417f-b297-2122fd346fc4,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1645a7ee-c8') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1645a7ee-c8, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1645a7ee-c8, col_values=(('external_ids', {'iface-id': '1645a7ee-c867-417f-b297-2122fd346fc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:ed:2b', 'vm-uuid': '48168dd3-a054-49e9-af8e-3d373378f87a'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:01 user nova-compute[72815]: INFO os_vif [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:ed:2b,bridge_name='br-int',has_traffic_filtering=True,id=1645a7ee-c867-417f-b297-2122fd346fc4,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1645a7ee-c8')
Aug 17 20:18:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:18:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] No VIF found with MAC fa:16:3e:52:ed:2b, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:18:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-503a1a01-e32d-438f-b70b-bca20b4e479a req-ce57450c-d3bf-4ef5-8fbc-5f77975442df service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:18:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-503a1a01-e32d-438f-b70b-bca20b4e479a req-ce57450c-d3bf-4ef5-8fbc-5f77975442df service nova] Acquiring lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-503a1a01-e32d-438f-b70b-bca20b4e479a req-ce57450c-d3bf-4ef5-8fbc-5f77975442df service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-503a1a01-e32d-438f-b70b-bca20b4e479a req-ce57450c-d3bf-4ef5-8fbc-5f77975442df service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:03 user nova-compute[72815]: DEBUG nova.compute.manager [req-503a1a01-e32d-438f-b70b-bca20b4e479a req-ce57450c-d3bf-4ef5-8fbc-5f77975442df service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] No waiting events found dispatching network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:18:03 user nova-compute[72815]: WARNING nova.compute.manager [req-503a1a01-e32d-438f-b70b-bca20b4e479a req-ce57450c-d3bf-4ef5-8fbc-5f77975442df service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received unexpected event network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 for instance with vm_state building and task_state spawning.
Aug 17 20:18:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303485.3503554, 48168dd3-a054-49e9-af8e-3d373378f87a => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:18:05 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] VM Resumed (Lifecycle Event)
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:18:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Instance spawned successfully.
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:18:05 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303485.3519886, 48168dd3-a054-49e9-af8e-3d373378f87a => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:18:05 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] VM Started (Lifecycle Event)
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:18:05 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:18:05 user nova-compute[72815]: INFO nova.compute.manager [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Took 5.32 seconds to spawn the instance on the hypervisor.
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-3f1fbdfd-e857-44fb-ae18-89e80a650511 req-b10a7aeb-e4b8-4792-bf3f-0b6daeb43294 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3f1fbdfd-e857-44fb-ae18-89e80a650511 req-b10a7aeb-e4b8-4792-bf3f-0b6daeb43294 service nova] Acquiring lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3f1fbdfd-e857-44fb-ae18-89e80a650511 req-b10a7aeb-e4b8-4792-bf3f-0b6daeb43294 service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3f1fbdfd-e857-44fb-ae18-89e80a650511 req-b10a7aeb-e4b8-4792-bf3f-0b6daeb43294 service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-3f1fbdfd-e857-44fb-ae18-89e80a650511 req-b10a7aeb-e4b8-4792-bf3f-0b6daeb43294 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] No waiting events found dispatching network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:18:05 user nova-compute[72815]: WARNING nova.compute.manager [req-3f1fbdfd-e857-44fb-ae18-89e80a650511 req-b10a7aeb-e4b8-4792-bf3f-0b6daeb43294 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received unexpected event network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 for instance with vm_state building and task_state spawning.
Aug 17 20:18:05 user nova-compute[72815]: INFO nova.compute.manager [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Took 17.77 seconds to build instance.
Aug 17 20:18:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d29cca98-6e4c-456e-8282-52f17ab4c066 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "48168dd3-a054-49e9-af8e-3d373378f87a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.908s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:06 user nova-compute[72815]: INFO nova.compute.manager [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Terminating instance
Aug 17 20:18:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-4cbed869-2c56-460b-9e5d-484a7cc85e18 req-9fa46695-9a57-440f-80cd-0fef4fc238c6 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Received event network-vif-unplugged-1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4cbed869-2c56-460b-9e5d-484a7cc85e18 req-9fa46695-9a57-440f-80cd-0fef4fc238c6 service nova] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4cbed869-2c56-460b-9e5d-484a7cc85e18 req-9fa46695-9a57-440f-80cd-0fef4fc238c6 service nova] Lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4cbed869-2c56-460b-9e5d-484a7cc85e18 req-9fa46695-9a57-440f-80cd-0fef4fc238c6 service nova] Lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-4cbed869-2c56-460b-9e5d-484a7cc85e18 req-9fa46695-9a57-440f-80cd-0fef4fc238c6 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] No waiting events found dispatching network-vif-unplugged-1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG nova.compute.manager [req-4cbed869-2c56-460b-9e5d-484a7cc85e18 req-9fa46695-9a57-440f-80cd-0fef4fc238c6 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Received event network-vif-unplugged-1fdf5978-653e-4453-afdf-8d9cfc420666 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:07 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Instance destroyed successfully.
Aug 17 20:18:07 user nova-compute[72815]: DEBUG nova.objects.instance [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lazy-loading 'resources' on Instance uuid 99693a7e-71e3-4543-b649-41a147c77c7e {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:18:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-188718305',display_name='tempest-SnapshotDataIntegrityTests-server-188718305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-188718305',id=34,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJARq4YtLUeaScgPTx+S8mFEgTezx/E/ls8lyBKcexD2cNEi+mEbxabl3USHGFy6tSXG72NQpfTfIlOA7tAhw6W+QLmvdxIQPvHwl9JwtgR31VUUS2Z90/t7sjJn+g2HEg==',key_name='tempest-keypair-736161106',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:07:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4773a7956484abfbcd86cc1a89c8dfd',ramdisk_id='',reservation_id='r-pw8qxral',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-334514141',owner_user_name='tempest-SnapshotDataIntegrityTests-334514141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75682a0e782445619cbbb7781d3e37a0',uuid=99693a7e-71e3-4543-b649-41a147c77c7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:18:07 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Converting VIF {"id": "1fdf5978-653e-4453-afdf-8d9cfc420666", "address": "fa:16:3e:29:77:f9", "network": {"id": "734045ff-cbb1-4195-9c43-508b9a929c94", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1596304367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4773a7956484abfbcd86cc1a89c8dfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdf5978-65", "ovs_interfaceid": "1fdf5978-653e-4453-afdf-8d9cfc420666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:18:07 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=1fdf5978-653e-4453-afdf-8d9cfc420666,network=Network(734045ff-cbb1-4195-9c43-508b9a929c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdf5978-65') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:18:07 user nova-compute[72815]: DEBUG os_vif [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=1fdf5978-653e-4453-afdf-8d9cfc420666,network=Network(734045ff-cbb1-4195-9c43-508b9a929c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdf5978-65') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:18:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fdf5978-65, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:18:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:18:07 user nova-compute[72815]: INFO os_vif [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=1fdf5978-653e-4453-afdf-8d9cfc420666,network=Network(734045ff-cbb1-4195-9c43-508b9a929c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdf5978-65')
Aug 17 20:18:07 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Deleting instance files /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e_del
Aug 17 20:18:07 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Deletion of /opt/stack/data/nova/instances/99693a7e-71e3-4543-b649-41a147c77c7e_del complete
Aug 17 20:18:07 user nova-compute[72815]: INFO nova.compute.manager [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 17 20:18:07 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:18:07 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:18:07 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:18:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:08 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:18:08 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Took 1.19 seconds to deallocate network for instance.
Aug 17 20:18:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-fc23defb-dd26-486f-b703-fc999ffc649e req-e820eebf-5aec-4198-b86e-b1e0f2f2ab8d service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Received event network-vif-deleted-1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:18:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-1646e0ce-5f41-4b8e-8b1b-9606a17b6cbd req-14dbf3c9-2d31-4197-880a-19996559a5c5 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Received event network-vif-plugged-1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:18:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1646e0ce-5f41-4b8e-8b1b-9606a17b6cbd req-14dbf3c9-2d31-4197-880a-19996559a5c5 service nova] Acquiring lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1646e0ce-5f41-4b8e-8b1b-9606a17b6cbd req-14dbf3c9-2d31-4197-880a-19996559a5c5 service nova] Lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1646e0ce-5f41-4b8e-8b1b-9606a17b6cbd req-14dbf3c9-2d31-4197-880a-19996559a5c5 service nova] Lock "99693a7e-71e3-4543-b649-41a147c77c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-1646e0ce-5f41-4b8e-8b1b-9606a17b6cbd req-14dbf3c9-2d31-4197-880a-19996559a5c5 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] No waiting events found dispatching network-vif-plugged-1fdf5978-653e-4453-afdf-8d9cfc420666 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:18:08 user nova-compute[72815]: WARNING nova.compute.manager [req-1646e0ce-5f41-4b8e-8b1b-9606a17b6cbd req-14dbf3c9-2d31-4197-880a-19996559a5c5 service nova] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Received unexpected event network-vif-plugged-1fdf5978-653e-4453-afdf-8d9cfc420666 for instance with vm_state deleted and task_state None.
Aug 17 20:18:08 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:18:08 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:18:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:08 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Deleted allocations for instance 99693a7e-71e3-4543-b649-41a147c77c7e
Aug 17 20:18:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-90055a7c-b53d-4687-a209-d4cbf246a415 tempest-SnapshotDataIntegrityTests-334514141 tempest-SnapshotDataIntegrityTests-334514141-project-member] Lock "99693a7e-71e3-4543-b649-41a147c77c7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.730s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:11 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303476.6924257, eb1a22c1-175e-480f-9ddf-cd297df993c8 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:18:11 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] VM Stopped (Lifecycle Event)
Aug 17 20:18:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-2423102c-16cf-4a29-ae51-bcb686114798 None None] [instance: eb1a22c1-175e-480f-9ddf-cd297df993c8] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:18:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:18:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:18 user nova-compute[72815]: INFO nova.compute.manager [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Detaching volume 8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3
Aug 17 20:18:18 user nova-compute[72815]: INFO nova.virt.block_device [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Attempting to driver detach volume 8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 from mountpoint /dev/vdb
Aug 17 20:18:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Attempting to detach device vdb from instance 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:18:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:18:18 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:18:18 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 20:18:18 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:18:18 user nova-compute[72815]:   <serial>8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3</serial>
Aug 17 20:18:18 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:18:18 user nova-compute[72815]: </disk>
Aug 17 20:18:18 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:18:18 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Successfully detached device vdb from instance 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 from the persistent domain config.
Aug 17 20:18:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:18:18 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:18:18 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:18:18 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 20:18:18 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:18:18 user nova-compute[72815]:   <serial>8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3</serial>
Aug 17 20:18:18 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:18:18 user nova-compute[72815]: </disk>
Aug 17 20:18:18 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:18:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692303499.202529, 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:18:19 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Successfully detached device vdb from instance 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 from the live domain config.
Aug 17 20:18:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcZOhGzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:18:19 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d333a7b-51c1-408e-aa8e-8f8fdc6afcaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebc233a-ee49-4dc8-ab04-65bcc1aca03f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)
Aug 17 20:18:19 user nova-compute[72815]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:18:19 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 (non-flash)
Aug 17 20:18:19 user nova-compute[72815]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:18:19 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944a5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3'): ({'sdc'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Removing single pathed devices sdc {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[922e3dec-36f1-4994-87f0-953869d69bcb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d58cb91-433a-44f5-9060-2d856fffada6]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Flushing IO for device /dev/sdc {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c717dbc4-70c4-4dfe-b4c9-8bb8c524caed]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4aad1f-74be-466e-b7a9-8f4455d26faa]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4418ac2e-d7ac-4054-8f5a-0dc381038ce6]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8497264a-2f37-45cd-8fc7-b431948a085f]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3, portal: 172.16.0.220,3260]
Aug 17 20:18:19 user nova-compute[72815]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3, portal: 172.16.0.220,3260] successful.
Aug 17 20:18:19 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd696220-8738-4961-ad99-1e10ffe23106]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] <== disconnect_volume: return (294ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:18:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG nova.objects.instance [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lazy-loading 'flavor' on Instance uuid 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-862418ef-b4ae-4879-8335-3abea40e3950 tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.895s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.780s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:20 user nova-compute[72815]: INFO nova.compute.manager [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Terminating instance
Aug 17 20:18:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-25891f10-4689-4dfb-a83e-c435fc2de4d4 req-beb8023c-e108-4391-8de1-538368acc43a service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Received event network-vif-unplugged-5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-25891f10-4689-4dfb-a83e-c435fc2de4d4 req-beb8023c-e108-4391-8de1-538368acc43a service nova] Acquiring lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-25891f10-4689-4dfb-a83e-c435fc2de4d4 req-beb8023c-e108-4391-8de1-538368acc43a service nova] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-25891f10-4689-4dfb-a83e-c435fc2de4d4 req-beb8023c-e108-4391-8de1-538368acc43a service nova] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-25891f10-4689-4dfb-a83e-c435fc2de4d4 req-beb8023c-e108-4391-8de1-538368acc43a service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] No waiting events found dispatching network-vif-unplugged-5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:18:20 user nova-compute[72815]: DEBUG nova.compute.manager [req-25891f10-4689-4dfb-a83e-c435fc2de4d4 req-beb8023c-e108-4391-8de1-538368acc43a service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Received event network-vif-unplugged-5eedb847-6aab-4b85-9e46-3ec250d0499c for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:18:21 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Instance destroyed successfully.
Aug 17 20:18:21 user nova-compute[72815]: DEBUG nova.objects.instance [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lazy-loading 'resources' on Instance uuid 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-970272825',display_name='tempest-VolumesSnapshotTestJSON-instance-970272825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-970272825',id=45,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgELU1SmOLAiL9HkHASCtIPhS3ju2VFYC6EcMnX8HpKIw9sOVaB7FXkdB73ATq9AQ5qNIlV1aFb/aTUZDWo4AokBRB+bWr91nrOyotblgv3caD8ra7I9MVKzrz5QsFgBA==',key_name='tempest-keypair-1669905795',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d837d09a38d4d97a262d1ca77c00134',ramdisk_id='',reservation_id='r-1cp72wsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-30442452',owner_user_name='tempest-VolumesSnapshotTestJSON-30442452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:15:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b344ee6f91744dd79f8a884a9212da6b',uuid=11d388da-9c0f-4ccf-8307-0cb7e1679fd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "address": "fa:16:3e:f0:81:a4", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eedb847-6a", "ovs_interfaceid": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Converting VIF {"id": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "address": "fa:16:3e:f0:81:a4", "network": {"id": "2aced268-e278-487b-a08b-5120ebb67476", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-726096864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d837d09a38d4d97a262d1ca77c00134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eedb847-6a", "ovs_interfaceid": "5eedb847-6aab-4b85-9e46-3ec250d0499c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:81:a4,bridge_name='br-int',has_traffic_filtering=True,id=5eedb847-6aab-4b85-9e46-3ec250d0499c,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eedb847-6a') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG os_vif [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:81:a4,bridge_name='br-int',has_traffic_filtering=True,id=5eedb847-6aab-4b85-9e46-3ec250d0499c,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eedb847-6a') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5eedb847-6a, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:18:21 user nova-compute[72815]: INFO os_vif [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:81:a4,bridge_name='br-int',has_traffic_filtering=True,id=5eedb847-6aab-4b85-9e46-3ec250d0499c,network=Network(2aced268-e278-487b-a08b-5120ebb67476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eedb847-6a')
Aug 17 20:18:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcZOhGzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:18:21 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:18:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f16ba17-e8f0-4da8-96bf-2435e3f1ddc3', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[115e469f-b287-4d73-8102-5f34e22f2231]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dae7055-1acd-4c4a-b8b2-dd7f5a93b352]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:18:21 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:18:21 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39944a4d30>, {}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Disconnecting from: [] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] <== disconnect_volume: return (57ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:18:21 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Deleting instance files /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2_del
Aug 17 20:18:21 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Deletion of /opt/stack/data/nova/instances/11d388da-9c0f-4ccf-8307-0cb7e1679fd2_del complete
Aug 17 20:18:21 user nova-compute[72815]: INFO nova.compute.manager [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 20:18:21 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:18:21 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:18:22 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303487.04996, 99693a7e-71e3-4543-b649-41a147c77c7e => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:18:22 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] VM Stopped (Lifecycle Event)
Aug 17 20:18:22 user nova-compute[72815]: DEBUG nova.compute.manager [None req-529c2596-e962-45b9-a330-96be07a84f2b None None] [instance: 99693a7e-71e3-4543-b649-41a147c77c7e] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:18:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:22 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:18:22 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Took 1.17 seconds to deallocate network for instance.
Aug 17 20:18:22 user nova-compute[72815]: WARNING nova.volume.cinder [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Attachment 2babe79f-a78b-4018-b769-98a4565b2dfc does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2babe79f-a78b-4018-b769-98a4565b2dfc. (HTTP 404) (Request-ID: req-7db6bf0d-8625-4263-bd52-bf21c8dc2574)
Aug 17 20:18:22 user nova-compute[72815]: INFO nova.compute.manager [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Took 0.03 seconds to detach 1 volumes for instance.
Aug 17 20:18:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f902742-f270-4f75-9e93-dd3d43bf131e req-cc598ef3-9180-49e4-964f-ae8972c50762 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Received event network-vif-plugged-5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:18:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f902742-f270-4f75-9e93-dd3d43bf131e req-cc598ef3-9180-49e4-964f-ae8972c50762 service nova] Acquiring lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f902742-f270-4f75-9e93-dd3d43bf131e req-cc598ef3-9180-49e4-964f-ae8972c50762 service nova] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:22 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-5f902742-f270-4f75-9e93-dd3d43bf131e req-cc598ef3-9180-49e4-964f-ae8972c50762 service nova] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f902742-f270-4f75-9e93-dd3d43bf131e req-cc598ef3-9180-49e4-964f-ae8972c50762 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] No waiting events found dispatching network-vif-plugged-5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:18:22 user nova-compute[72815]: WARNING nova.compute.manager [req-5f902742-f270-4f75-9e93-dd3d43bf131e req-cc598ef3-9180-49e4-964f-ae8972c50762 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Received unexpected event network-vif-plugged-5eedb847-6aab-4b85-9e46-3ec250d0499c for instance with vm_state deleted and task_state None.
Aug 17 20:18:22 user nova-compute[72815]: DEBUG nova.compute.manager [req-5f902742-f270-4f75-9e93-dd3d43bf131e req-cc598ef3-9180-49e4-964f-ae8972c50762 service nova] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Received event network-vif-deleted-5eedb847-6aab-4b85-9e46-3ec250d0499c {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:18:22 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:18:22 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:18:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:23 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Deleted allocations for instance 11d388da-9c0f-4ccf-8307-0cb7e1679fd2
Aug 17 20:18:23 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-40ecceb0-02fe-4383-a91b-234aabc54bfa tempest-VolumesSnapshotTestJSON-30442452 tempest-VolumesSnapshotTestJSON-30442452-project-member] Lock "11d388da-9c0f-4ccf-8307-0cb7e1679fd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.610s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:26 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:31 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:36 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303501.3422592, 11d388da-9c0f-4ccf-8307-0cb7e1679fd2 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:18:36 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] VM Stopped (Lifecycle Event)
Aug 17 20:18:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-901881ea-3478-4685-91af-9bef969bcb0e None None] [instance: 11d388da-9c0f-4ccf-8307-0cb7e1679fd2] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:18:36 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:37 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:18:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:37 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:18:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:18:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:18:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:18:39 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:18:39 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:18:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=8083MB free_disk=25.36208724975586GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:18:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 0145191d-46b5-458c-9e04-136bd4635d40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:18:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 34cd7ece-316a-419a-ab48-8f7dbfd7d78a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:18:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 48168dd3-a054-49e9-af8e-3d373378f87a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:18:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:18:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:18:39 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:18:39 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:18:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:18:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:46 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:18:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:18:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 20:18:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:18:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:18:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:18:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:48 user nova-compute[72815]: INFO nova.compute.manager [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Terminating instance
Aug 17 20:18:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:18:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-f2c67319-acbf-4b79-80bd-f8f03e37bec5 req-6ab8213c-e68e-4ee8-85cb-5a5f0cfc2d08 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-vif-unplugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f2c67319-acbf-4b79-80bd-f8f03e37bec5 req-6ab8213c-e68e-4ee8-85cb-5a5f0cfc2d08 service nova] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f2c67319-acbf-4b79-80bd-f8f03e37bec5 req-6ab8213c-e68e-4ee8-85cb-5a5f0cfc2d08 service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f2c67319-acbf-4b79-80bd-f8f03e37bec5 req-6ab8213c-e68e-4ee8-85cb-5a5f0cfc2d08 service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-f2c67319-acbf-4b79-80bd-f8f03e37bec5 req-6ab8213c-e68e-4ee8-85cb-5a5f0cfc2d08 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] No waiting events found dispatching network-vif-unplugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-f2c67319-acbf-4b79-80bd-f8f03e37bec5 req-6ab8213c-e68e-4ee8-85cb-5a5f0cfc2d08 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-vif-unplugged-331a772e-61c5-4bbe-920e-f37642d7e012 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:49 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Instance destroyed successfully.
Aug 17 20:18:49 user nova-compute[72815]: DEBUG nova.objects.instance [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'resources' on Instance uuid 0145191d-46b5-458c-9e04-136bd4635d40 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:13:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1572011402',display_name='tempest-TestMinimumBasicScenario-server-1572011402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1572011402',id=41,image_ref='d056c8b4-77aa-433b-b557-9b79ffe99fcc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdcKNFaoSkdo7iHnLFkpML2OqmZhygzWP0YgyuNWEYFJ0wwOw/haiTNxzu8cIy4BmFv2SBgmUKXfdh2hXXKSf9ZkedCiO5b5CHkbGKuCKDBgfrzwHUR4zJIN+6BM4lQRA==',key_name='tempest-TestMinimumBasicScenario-1144594707',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:13:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6adbeb02ec1e45b3b7c2af06e7cb92cf',ramdisk_id='',reservation_id='r-s2sausqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d056c8b4-77aa-433b-b557-9b79ffe99fcc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1472868221',owner_user_name='tempest-TestMinimumBasicScenario-1472868221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:16:03Z,user_data=None,user_id='39ef6674029a4e51bfd614a9a834970c',uuid=0145191d-46b5-458c-9e04-136bd4635d40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converting VIF {"id": "331a772e-61c5-4bbe-920e-f37642d7e012", "address": "fa:16:3e:fa:90:a8", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331a772e-61", "ovs_interfaceid": "331a772e-61c5-4bbe-920e-f37642d7e012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG os_vif [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap331a772e-61, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:18:49 user nova-compute[72815]: INFO os_vif [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=331a772e-61c5-4bbe-920e-f37642d7e012,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331a772e-61')
Aug 17 20:18:49 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Deleting instance files /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40_del
Aug 17 20:18:49 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Deletion of /opt/stack/data/nova/instances/0145191d-46b5-458c-9e04-136bd4635d40_del complete
Aug 17 20:18:49 user nova-compute[72815]: INFO nova.compute.manager [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 20:18:49 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:18:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:50 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:18:50 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Took 1.04 seconds to deallocate network for instance.
Aug 17 20:18:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-e6d3ec2f-3dbe-4444-b3ae-f4f952daabdf req-bffde0e0-61ad-4528-84df-07f554d31679 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-vif-deleted-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:18:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:50 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:18:50 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:18:50 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:18:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:51 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Deleted allocations for instance 0145191d-46b5-458c-9e04-136bd4635d40
Aug 17 20:18:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-8535830a-5dc3-4b81-bf35-d090c7dde366 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "0145191d-46b5-458c-9e04-136bd4635d40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.334s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:51 user nova-compute[72815]: DEBUG nova.compute.manager [req-c2717a0a-3606-41fe-9f80-560b028c9768 req-14715332-1ceb-415d-aeee-4a237930dac8 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received event network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:18:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c2717a0a-3606-41fe-9f80-560b028c9768 req-14715332-1ceb-415d-aeee-4a237930dac8 service nova] Acquiring lock "0145191d-46b5-458c-9e04-136bd4635d40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:18:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c2717a0a-3606-41fe-9f80-560b028c9768 req-14715332-1ceb-415d-aeee-4a237930dac8 service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:18:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c2717a0a-3606-41fe-9f80-560b028c9768 req-14715332-1ceb-415d-aeee-4a237930dac8 service nova] Lock "0145191d-46b5-458c-9e04-136bd4635d40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:18:51 user nova-compute[72815]: DEBUG nova.compute.manager [req-c2717a0a-3606-41fe-9f80-560b028c9768 req-14715332-1ceb-415d-aeee-4a237930dac8 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] No waiting events found dispatching network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:18:51 user nova-compute[72815]: WARNING nova.compute.manager [req-c2717a0a-3606-41fe-9f80-560b028c9768 req-14715332-1ceb-415d-aeee-4a237930dac8 service nova] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Received unexpected event network-vif-plugged-331a772e-61c5-4bbe-920e-f37642d7e012 for instance with vm_state deleted and task_state None.
Aug 17 20:18:51 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:18:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:18:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:19:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:04 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303529.6024635, 0145191d-46b5-458c-9e04-136bd4635d40 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:19:04 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] VM Stopped (Lifecycle Event)
Aug 17 20:19:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-937f29eb-dbaf-4dc9-a4fd-3b2ecd4efbd5 None None] [instance: 0145191d-46b5-458c-9e04-136bd4635d40] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:19:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Acquiring lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Acquiring lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:11 user nova-compute[72815]: INFO nova.compute.manager [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Terminating instance
Aug 17 20:19:11 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a80f96d-f0c4-41f5-a237-44ce8e010286 req-94002253-4b1a-4ab9-bc93-b49d5143c707 service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Received event network-vif-unplugged-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a80f96d-f0c4-41f5-a237-44ce8e010286 req-94002253-4b1a-4ab9-bc93-b49d5143c707 service nova] Acquiring lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a80f96d-f0c4-41f5-a237-44ce8e010286 req-94002253-4b1a-4ab9-bc93-b49d5143c707 service nova] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a80f96d-f0c4-41f5-a237-44ce8e010286 req-94002253-4b1a-4ab9-bc93-b49d5143c707 service nova] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a80f96d-f0c4-41f5-a237-44ce8e010286 req-94002253-4b1a-4ab9-bc93-b49d5143c707 service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] No waiting events found dispatching network-vif-unplugged-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:19:11 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a80f96d-f0c4-41f5-a237-44ce8e010286 req-94002253-4b1a-4ab9-bc93-b49d5143c707 service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Received event network-vif-unplugged-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:19:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Instance destroyed successfully.
Aug 17 20:19:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lazy-loading 'resources' on Instance uuid 34cd7ece-316a-419a-ab48-8f7dbfd7d78a {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1275003686',display_name='tempest-VolumesActionsTest-instance-1275003686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1275003686',id=46,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:17:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edb24b524a204e0da9cea0d4b784a827',ramdisk_id='',reservation_id='r-zbo70sev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1897613823',owner_user_name='tempest-VolumesActionsTest-1897613823-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:17:16Z,user_data=None,user_id='59da49ffd7f449dfad2626e0eb2d85bf',uuid=34cd7ece-316a-419a-ab48-8f7dbfd7d78a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "address": "fa:16:3e:04:42:0c", "network": {"id": "286b5cca-939f-48af-a6b7-3ae07815935a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432746986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb24b524a204e0da9cea0d4b784a827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape581f6a0-9e", "ovs_interfaceid": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Converting VIF {"id": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "address": "fa:16:3e:04:42:0c", "network": {"id": "286b5cca-939f-48af-a6b7-3ae07815935a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432746986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb24b524a204e0da9cea0d4b784a827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape581f6a0-9e", "ovs_interfaceid": "e581f6a0-9e48-41d0-a2e5-e65f806e5b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:42:0c,bridge_name='br-int',has_traffic_filtering=True,id=e581f6a0-9e48-41d0-a2e5-e65f806e5b60,network=Network(286b5cca-939f-48af-a6b7-3ae07815935a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape581f6a0-9e') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG os_vif [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:42:0c,bridge_name='br-int',has_traffic_filtering=True,id=e581f6a0-9e48-41d0-a2e5-e65f806e5b60,network=Network(286b5cca-939f-48af-a6b7-3ae07815935a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape581f6a0-9e') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape581f6a0-9e, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:19:12 user nova-compute[72815]: INFO os_vif [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:42:0c,bridge_name='br-int',has_traffic_filtering=True,id=e581f6a0-9e48-41d0-a2e5-e65f806e5b60,network=Network(286b5cca-939f-48af-a6b7-3ae07815935a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape581f6a0-9e')
Aug 17 20:19:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Deleting instance files /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a_del
Aug 17 20:19:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Deletion of /opt/stack/data/nova/instances/34cd7ece-316a-419a-ab48-8f7dbfd7d78a_del complete
Aug 17 20:19:12 user nova-compute[72815]: INFO nova.compute.manager [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 20:19:12 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:19:12 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Took 0.64 seconds to deallocate network for instance.
Aug 17 20:19:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-33ead421-90e4-4f52-82c9-ae614ac845f6 req-427b58e3-31e2-4de9-82cd-f1f7bafa1d5f service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Received event network-vif-deleted-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:13 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:19:13 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:19:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:13 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Deleted allocations for instance 34cd7ece-316a-419a-ab48-8f7dbfd7d78a
Aug 17 20:19:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e7b37d2-b58b-41b1-a31b-7a86d9064cfa tempest-VolumesActionsTest-1897613823 tempest-VolumesActionsTest-1897613823-project-member] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.932s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-4e1122f6-8efc-4d05-a67f-a5f6f2b8aab6 req-62dddca5-0ff6-4381-b416-f118f78a78fe service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Received event network-vif-plugged-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:19:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4e1122f6-8efc-4d05-a67f-a5f6f2b8aab6 req-62dddca5-0ff6-4381-b416-f118f78a78fe service nova] Acquiring lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4e1122f6-8efc-4d05-a67f-a5f6f2b8aab6 req-62dddca5-0ff6-4381-b416-f118f78a78fe service nova] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:13 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4e1122f6-8efc-4d05-a67f-a5f6f2b8aab6 req-62dddca5-0ff6-4381-b416-f118f78a78fe service nova] Lock "34cd7ece-316a-419a-ab48-8f7dbfd7d78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:13 user nova-compute[72815]: DEBUG nova.compute.manager [req-4e1122f6-8efc-4d05-a67f-a5f6f2b8aab6 req-62dddca5-0ff6-4381-b416-f118f78a78fe service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] No waiting events found dispatching network-vif-plugged-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:19:13 user nova-compute[72815]: WARNING nova.compute.manager [req-4e1122f6-8efc-4d05-a67f-a5f6f2b8aab6 req-62dddca5-0ff6-4381-b416-f118f78a78fe service nova] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Received unexpected event network-vif-plugged-e581f6a0-9e48-41d0-a2e5-e65f806e5b60 for instance with vm_state deleted and task_state None.
Aug 17 20:19:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:27 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303552.1221154, 34cd7ece-316a-419a-ab48-8f7dbfd7d78a => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:19:27 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] VM Stopped (Lifecycle Event)
Aug 17 20:19:27 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f7d1bd38-754b-4482-adaf-9161dd702773 None None] [instance: 34cd7ece-316a-419a-ab48-8f7dbfd7d78a] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:19:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:19:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:19:39 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:19:39 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:19:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:39 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:19:40 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:19:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-1217e1d6-6cc6-4bbf-933e-94608c7e6bf6 req-8f016efb-7405-4002-8da2-e3cd339d80d3 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-changed-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:19:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-1217e1d6-6cc6-4bbf-933e-94608c7e6bf6 req-8f016efb-7405-4002-8da2-e3cd339d80d3 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Refreshing instance network info cache due to event network-changed-1645a7ee-c867-417f-b297-2122fd346fc4. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:19:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1217e1d6-6cc6-4bbf-933e-94608c7e6bf6 req-8f016efb-7405-4002-8da2-e3cd339d80d3 service nova] Acquiring lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:19:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1217e1d6-6cc6-4bbf-933e-94608c7e6bf6 req-8f016efb-7405-4002-8da2-e3cd339d80d3 service nova] Acquired lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:19:40 user nova-compute[72815]: DEBUG nova.network.neutron [req-1217e1d6-6cc6-4bbf-933e-94608c7e6bf6 req-8f016efb-7405-4002-8da2-e3cd339d80d3 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Refreshing network info cache for port 1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:19:40 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:19:40 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:19:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=8412MB free_disk=25.441509246826172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:19:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 48168dd3-a054-49e9-af8e-3d373378f87a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:19:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:19:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:19:41 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:19:41 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:19:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:19:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:19:41 user nova-compute[72815]: DEBUG nova.network.neutron [req-1217e1d6-6cc6-4bbf-933e-94608c7e6bf6 req-8f016efb-7405-4002-8da2-e3cd339d80d3 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updated VIF entry in instance network info cache for port 1645a7ee-c867-417f-b297-2122fd346fc4. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:19:41 user nova-compute[72815]: DEBUG nova.network.neutron [req-1217e1d6-6cc6-4bbf-933e-94608c7e6bf6 req-8f016efb-7405-4002-8da2-e3cd339d80d3 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updating instance_info_cache with network_info: [{"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:19:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-1217e1d6-6cc6-4bbf-933e-94608c7e6bf6 req-8f016efb-7405-4002-8da2-e3cd339d80d3 service nova] Releasing lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:19:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:19:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:19:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:44 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:19:44 user nova-compute[72815]: INFO nova.compute.claims [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Claim successful on node user
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Refreshing inventories for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Updating ProviderTree inventory for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Updating inventory in ProviderTree for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Refreshing aggregate associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, aggregates: None {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Refreshing trait associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.network.neutron [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:19:45 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.policy [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39ef6674029a4e51bfd614a9a834970c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adbeb02ec1e45b3b7c2af06e7cb92cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.compute.manager [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:19:45 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Creating image(s)
Aug 17 20:19:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "/opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "/opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "/opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2.part --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Skipping network cache update for instance because it is Building. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG nova.objects.instance [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lazy-loading 'info_cache' on Instance uuid 48168dd3-a054-49e9-af8e-3d373378f87a {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2.part --force-share --output=json" returned: 0 in 0.202s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG nova.virt.images [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] a2ccfdb8-e1b1-4f73-bba9-b134b6436c28 was qcow2, converting to raw {{(pid=72815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG nova.privsep.utils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 20:19:46 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2.part /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2.converted {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG nova.network.neutron [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Successfully created port: 6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2.part /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2.converted" returned: 0 in 0.557s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2.converted --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2.converted --force-share --output=json" returned: 0 in 0.243s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.573s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2 --force-share --output=json" returned: 0 in 0.274s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2 --force-share --output=json" returned: 0 in 0.225s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2,backing_fmt=raw /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2,backing_fmt=raw /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk 1073741824" returned: 0 in 0.066s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:47 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2 --force-share --output=json" returned: 0 in 0.249s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updating instance_info_cache with network_info: [{"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.network.neutron [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Successfully updated port: 6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquired lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.network.neutron [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-a2ff5e9d-6f96-4375-8444-c7c2ade73292 req-e183b918-8eb9-4a5c-9586-a43718142795 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-changed-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-a2ff5e9d-6f96-4375-8444-c7c2ade73292 req-e183b918-8eb9-4a5c-9586-a43718142795 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Refreshing instance network info cache due to event network-changed-6e92fa72-b9bc-4631-8620-2acce92bacab. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a2ff5e9d-6f96-4375-8444-c7c2ade73292 req-e183b918-8eb9-4a5c-9586-a43718142795 service nova] Acquiring lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.network.neutron [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Cannot resize image /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.objects.instance [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'migration_context' on Instance uuid 20a2c899-49ce-4118-be88-4be69dc205fb {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Ensure instance console log exists: /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.network.neutron [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updating instance_info_cache with network_info: [{"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Releasing lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Instance network_info: |[{"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a2ff5e9d-6f96-4375-8444-c7c2ade73292 req-e183b918-8eb9-4a5c-9586-a43718142795 service nova] Acquired lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.network.neutron [req-a2ff5e9d-6f96-4375-8444-c7c2ade73292 req-e183b918-8eb9-4a5c-9586-a43718142795 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Refreshing network info cache for port 6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Start _get_guest_xml network_info=[{"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T20:19:41Z,direct_url=<?>,disk_format='qcow2',id=a2ccfdb8-e1b1-4f73-bba9-b134b6436c28,min_disk=0,min_ram=0,name='tempest-scenario-img--1396653708',owner='6adbeb02ec1e45b3b7c2af06e7cb92cf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T20:19:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': 'a2ccfdb8-e1b1-4f73-bba9-b134b6436c28'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:19:48 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:19:48 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T20:19:41Z,direct_url=<?>,disk_format='qcow2',id=a2ccfdb8-e1b1-4f73-bba9-b134b6436c28,min_disk=0,min_ram=0,name='tempest-scenario-img--1396653708',owner='6adbeb02ec1e45b3b7c2af06e7cb92cf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T20:19:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:19:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-332683521',display_name='tempest-TestMinimumBasicScenario-server-332683521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-332683521',id=48,image_ref='a2ccfdb8-e1b1-4f73-bba9-b134b6436c28',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIumA8PFaYLbKQ+bhy1YFjZoYOGUv+seEAbHpBQrIhRqcOXuJmndc98za0aw1IHGw5bovmLJwC12/Taj/+qE0bknA0xd7Li4Ybo4z9ldvQQrjKHFPRkfL5yLep1dfN5pxA==',key_name='tempest-TestMinimumBasicScenario-1186874166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6adbeb02ec1e45b3b7c2af06e7cb92cf',ramdisk_id='',reservation_id='r-otyon7c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a2ccfdb8-e1b1-4f73-bba9-b134b6436c28',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1472868221',owner_user_name='tempest-TestMinimumBasicScenario-1472868221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:19:46Z,user_data=None,user_id='39ef6674029a4e51bfd614a9a834970c',uuid=20a2c899-49ce-4118-be88-4be69dc205fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converting VIF {"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=6e92fa72-b9bc-4631-8620-2acce92bacab,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e92fa72-b9') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.objects.instance [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'pci_devices' on Instance uuid 20a2c899-49ce-4118-be88-4be69dc205fb {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:19:48 user nova-compute[72815]:   <uuid>20a2c899-49ce-4118-be88-4be69dc205fb</uuid>
Aug 17 20:19:48 user nova-compute[72815]:   <name>instance-00000030</name>
Aug 17 20:19:48 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:19:48 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:19:48 user nova-compute[72815]:   <metadata>
Aug 17 20:19:48 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:19:48 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:19:48 user nova-compute[72815]:       <nova:name>tempest-TestMinimumBasicScenario-server-332683521</nova:name>
Aug 17 20:19:48 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:19:48</nova:creationTime>
Aug 17 20:19:48 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:19:48 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:19:48 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:19:48 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:19:48 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:19:48 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:19:48 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:19:48 user nova-compute[72815]:       <nova:owner>
Aug 17 20:19:48 user nova-compute[72815]:         <nova:user uuid="39ef6674029a4e51bfd614a9a834970c">tempest-TestMinimumBasicScenario-1472868221-project-member</nova:user>
Aug 17 20:19:48 user nova-compute[72815]:         <nova:project uuid="6adbeb02ec1e45b3b7c2af06e7cb92cf">tempest-TestMinimumBasicScenario-1472868221</nova:project>
Aug 17 20:19:48 user nova-compute[72815]:       </nova:owner>
Aug 17 20:19:48 user nova-compute[72815]:       <nova:root type="image" uuid="a2ccfdb8-e1b1-4f73-bba9-b134b6436c28"/>
Aug 17 20:19:48 user nova-compute[72815]:       <nova:ports>
Aug 17 20:19:48 user nova-compute[72815]:         <nova:port uuid="6e92fa72-b9bc-4631-8620-2acce92bacab">
Aug 17 20:19:48 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 20:19:48 user nova-compute[72815]:         </nova:port>
Aug 17 20:19:48 user nova-compute[72815]:       </nova:ports>
Aug 17 20:19:48 user nova-compute[72815]:     </nova:instance>
Aug 17 20:19:48 user nova-compute[72815]:   </metadata>
Aug 17 20:19:48 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:19:48 user nova-compute[72815]:     <system>
Aug 17 20:19:48 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:19:48 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:19:48 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:19:48 user nova-compute[72815]:       <entry name="serial">20a2c899-49ce-4118-be88-4be69dc205fb</entry>
Aug 17 20:19:48 user nova-compute[72815]:       <entry name="uuid">20a2c899-49ce-4118-be88-4be69dc205fb</entry>
Aug 17 20:19:48 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:19:48 user nova-compute[72815]:     </system>
Aug 17 20:19:48 user nova-compute[72815]:   </sysinfo>
Aug 17 20:19:48 user nova-compute[72815]:   <os>
Aug 17 20:19:48 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:19:48 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:19:48 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:19:48 user nova-compute[72815]:   </os>
Aug 17 20:19:48 user nova-compute[72815]:   <features>
Aug 17 20:19:48 user nova-compute[72815]:     <acpi/>
Aug 17 20:19:48 user nova-compute[72815]:     <apic/>
Aug 17 20:19:48 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:19:48 user nova-compute[72815]:   </features>
Aug 17 20:19:48 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:19:48 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:19:48 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:19:48 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:19:48 user nova-compute[72815]:   </clock>
Aug 17 20:19:48 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:19:48 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:19:48 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:19:48 user nova-compute[72815]:   </cpu>
Aug 17 20:19:48 user nova-compute[72815]:   <devices>
Aug 17 20:19:48 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:19:48 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:19:48 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk"/>
Aug 17 20:19:48 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:19:48 user nova-compute[72815]:     </disk>
Aug 17 20:19:48 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:19:48 user nova-compute[72815]:       <mac address="fa:16:3e:92:d7:ac"/>
Aug 17 20:19:48 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:19:48 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:19:48 user nova-compute[72815]:       <target dev="tap6e92fa72-b9"/>
Aug 17 20:19:48 user nova-compute[72815]:     </interface>
Aug 17 20:19:48 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:19:48 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/console.log" append="off"/>
Aug 17 20:19:48 user nova-compute[72815]:     </serial>
Aug 17 20:19:48 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:19:48 user nova-compute[72815]:     <video>
Aug 17 20:19:48 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:19:48 user nova-compute[72815]:     </video>
Aug 17 20:19:48 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:19:48 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:19:48 user nova-compute[72815]:     </rng>
Aug 17 20:19:48 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:19:48 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:19:48 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:19:48 user nova-compute[72815]:     </memballoon>
Aug 17 20:19:48 user nova-compute[72815]:   </devices>
Aug 17 20:19:48 user nova-compute[72815]: </domain>
Aug 17 20:19:48 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:19:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-332683521',display_name='tempest-TestMinimumBasicScenario-server-332683521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-332683521',id=48,image_ref='a2ccfdb8-e1b1-4f73-bba9-b134b6436c28',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIumA8PFaYLbKQ+bhy1YFjZoYOGUv+seEAbHpBQrIhRqcOXuJmndc98za0aw1IHGw5bovmLJwC12/Taj/+qE0bknA0xd7Li4Ybo4z9ldvQQrjKHFPRkfL5yLep1dfN5pxA==',key_name='tempest-TestMinimumBasicScenario-1186874166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6adbeb02ec1e45b3b7c2af06e7cb92cf',ramdisk_id='',reservation_id='r-otyon7c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a2ccfdb8-e1b1-4f73-bba9-b134b6436c28',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1472868221',owner_user_name='tempest-TestMinimumBasicScenario-1472868221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:19:46Z,user_data=None,user_id='39ef6674029a4e51bfd614a9a834970c',uuid=20a2c899-49ce-4118-be88-4be69dc205fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converting VIF {"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=6e92fa72-b9bc-4631-8620-2acce92bacab,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e92fa72-b9') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG os_vif [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=6e92fa72-b9bc-4631-8620-2acce92bacab,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e92fa72-b9') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e92fa72-b9, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e92fa72-b9, col_values=(('external_ids', {'iface-id': '6e92fa72-b9bc-4631-8620-2acce92bacab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:d7:ac', 'vm-uuid': '20a2c899-49ce-4118-be88-4be69dc205fb'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:48 user nova-compute[72815]: INFO os_vif [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=6e92fa72-b9bc-4631-8620-2acce92bacab,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e92fa72-b9')
Aug 17 20:19:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:19:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] No VIF found with MAC fa:16:3e:92:d7:ac, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:19:49 user nova-compute[72815]: DEBUG nova.network.neutron [req-a2ff5e9d-6f96-4375-8444-c7c2ade73292 req-e183b918-8eb9-4a5c-9586-a43718142795 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updated VIF entry in instance network info cache for port 6e92fa72-b9bc-4631-8620-2acce92bacab. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:19:49 user nova-compute[72815]: DEBUG nova.network.neutron [req-a2ff5e9d-6f96-4375-8444-c7c2ade73292 req-e183b918-8eb9-4a5c-9586-a43718142795 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updating instance_info_cache with network_info: [{"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:19:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-a2ff5e9d-6f96-4375-8444-c7c2ade73292 req-e183b918-8eb9-4a5c-9586-a43718142795 service nova] Releasing lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:19:49 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:19:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:19:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-42c62e4f-193a-45ca-8648-90b76b742eec req-e24c04e9-b4ae-47d0-85f9-6a32d0e34fd5 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:19:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42c62e4f-193a-45ca-8648-90b76b742eec req-e24c04e9-b4ae-47d0-85f9-6a32d0e34fd5 service nova] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42c62e4f-193a-45ca-8648-90b76b742eec req-e24c04e9-b4ae-47d0-85f9-6a32d0e34fd5 service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-42c62e4f-193a-45ca-8648-90b76b742eec req-e24c04e9-b4ae-47d0-85f9-6a32d0e34fd5 service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-42c62e4f-193a-45ca-8648-90b76b742eec req-e24c04e9-b4ae-47d0-85f9-6a32d0e34fd5 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] No waiting events found dispatching network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:19:50 user nova-compute[72815]: WARNING nova.compute.manager [req-42c62e4f-193a-45ca-8648-90b76b742eec req-e24c04e9-b4ae-47d0-85f9-6a32d0e34fd5 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received unexpected event network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab for instance with vm_state building and task_state spawning.
Aug 17 20:19:50 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:19:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:51 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:19:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-9a193353-715b-40d6-9103-1c635a9180bb req-6f41ec9a-8d67-4adf-89d6-bfda8c9cff68 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:19:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9a193353-715b-40d6-9103-1c635a9180bb req-6f41ec9a-8d67-4adf-89d6-bfda8c9cff68 service nova] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9a193353-715b-40d6-9103-1c635a9180bb req-6f41ec9a-8d67-4adf-89d6-bfda8c9cff68 service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9a193353-715b-40d6-9103-1c635a9180bb req-6f41ec9a-8d67-4adf-89d6-bfda8c9cff68 service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:52 user nova-compute[72815]: DEBUG nova.compute.manager [req-9a193353-715b-40d6-9103-1c635a9180bb req-6f41ec9a-8d67-4adf-89d6-bfda8c9cff68 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] No waiting events found dispatching network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:19:52 user nova-compute[72815]: WARNING nova.compute.manager [req-9a193353-715b-40d6-9103-1c635a9180bb req-6f41ec9a-8d67-4adf-89d6-bfda8c9cff68 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received unexpected event network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab for instance with vm_state building and task_state spawning.
Aug 17 20:19:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303593.0543532, 20a2c899-49ce-4118-be88-4be69dc205fb => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:19:53 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] VM Resumed (Lifecycle Event)
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:19:53 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Instance spawned successfully.
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:19:53 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303593.0557272, 20a2c899-49ce-4118-be88-4be69dc205fb => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:19:53 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] VM Started (Lifecycle Event)
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:19:53 user nova-compute[72815]: INFO nova.compute.manager [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Took 7.49 seconds to spawn the instance on the hypervisor.
Aug 17 20:19:53 user nova-compute[72815]: DEBUG nova.compute.manager [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:19:53 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:19:53 user nova-compute[72815]: INFO nova.compute.manager [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Took 8.49 seconds to build instance.
Aug 17 20:19:53 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-87ddd5cb-05b8-4a7b-8801-83e22af2a298 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.716s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:19:54 user nova-compute[72815]: INFO nova.compute.claims [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Claim successful on node user
Aug 17 20:19:54 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG nova.network.neutron [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:19:54 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:19:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG nova.policy [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d0912af2d65439f9f816c6aa00e9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c884a816adc40bf9932e18058380156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:19:54 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Creating image(s)
Aug 17 20:19:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "/opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:54 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "/opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "/opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.226s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.270s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk 1073741824" returned: 0 in 0.059s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG nova.network.neutron [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Successfully created port: 5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.243s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:19:55 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Cannot resize image /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG nova.objects.instance [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lazy-loading 'migration_context' on Instance uuid d73a930e-2c4c-42d4-a126-dd6a04d4dbe6 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Ensure instance console log exists: /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG nova.network.neutron [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Successfully updated port: 5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "refresh_cache-d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquired lock "refresh_cache-d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG nova.network.neutron [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-2a51e145-d1ee-4d29-8a5d-d9f849df5048 req-f16a63ec-80ee-4b42-b690-de82ec6951a8 service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Received event network-changed-5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG nova.compute.manager [req-2a51e145-d1ee-4d29-8a5d-d9f849df5048 req-f16a63ec-80ee-4b42-b690-de82ec6951a8 service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Refreshing instance network info cache due to event network-changed-5127c14c-89b2-4b72-baae-0d530cb06de6. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2a51e145-d1ee-4d29-8a5d-d9f849df5048 req-f16a63ec-80ee-4b42-b690-de82ec6951a8 service nova] Acquiring lock "refresh_cache-d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:19:56 user nova-compute[72815]: DEBUG nova.network.neutron [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.network.neutron [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Updating instance_info_cache with network_info: [{"id": "5127c14c-89b2-4b72-baae-0d530cb06de6", "address": "fa:16:3e:95:4b:01", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5127c14c-89", "ovs_interfaceid": "5127c14c-89b2-4b72-baae-0d530cb06de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Releasing lock "refresh_cache-d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.compute.manager [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Instance network_info: |[{"id": "5127c14c-89b2-4b72-baae-0d530cb06de6", "address": "fa:16:3e:95:4b:01", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5127c14c-89", "ovs_interfaceid": "5127c14c-89b2-4b72-baae-0d530cb06de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2a51e145-d1ee-4d29-8a5d-d9f849df5048 req-f16a63ec-80ee-4b42-b690-de82ec6951a8 service nova] Acquired lock "refresh_cache-d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-2a51e145-d1ee-4d29-8a5d-d9f849df5048 req-f16a63ec-80ee-4b42-b690-de82ec6951a8 service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Refreshing network info cache for port 5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Start _get_guest_xml network_info=[{"id": "5127c14c-89b2-4b72-baae-0d530cb06de6", "address": "fa:16:3e:95:4b:01", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5127c14c-89", "ovs_interfaceid": "5127c14c-89b2-4b72-baae-0d530cb06de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:19:57 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:19:57 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-942346103',display_name='tempest-VolumesActionsTest-instance-942346103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-942346103',id=49,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c884a816adc40bf9932e18058380156',ramdisk_id='',reservation_id='r-n7dliubw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-396564338',owner_user_name='tempest-VolumesActionsTest-396564338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:19:55Z,user_data=None,user_id='5d0912af2d65439f9f816c6aa00e9a56',uuid=d73a930e-2c4c-42d4-a126-dd6a04d4dbe6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5127c14c-89b2-4b72-baae-0d530cb06de6", "address": "fa:16:3e:95:4b:01", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5127c14c-89", "ovs_interfaceid": "5127c14c-89b2-4b72-baae-0d530cb06de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Converting VIF {"id": "5127c14c-89b2-4b72-baae-0d530cb06de6", "address": "fa:16:3e:95:4b:01", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5127c14c-89", "ovs_interfaceid": "5127c14c-89b2-4b72-baae-0d530cb06de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=5127c14c-89b2-4b72-baae-0d530cb06de6,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5127c14c-89') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.objects.instance [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lazy-loading 'pci_devices' on Instance uuid d73a930e-2c4c-42d4-a126-dd6a04d4dbe6 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:19:57 user nova-compute[72815]:   <uuid>d73a930e-2c4c-42d4-a126-dd6a04d4dbe6</uuid>
Aug 17 20:19:57 user nova-compute[72815]:   <name>instance-00000031</name>
Aug 17 20:19:57 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:19:57 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:19:57 user nova-compute[72815]:   <metadata>
Aug 17 20:19:57 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:19:57 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:19:57 user nova-compute[72815]:       <nova:name>tempest-VolumesActionsTest-instance-942346103</nova:name>
Aug 17 20:19:57 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:19:57</nova:creationTime>
Aug 17 20:19:57 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:19:57 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:19:57 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:19:57 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:19:57 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:19:57 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:19:57 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:19:57 user nova-compute[72815]:       <nova:owner>
Aug 17 20:19:57 user nova-compute[72815]:         <nova:user uuid="5d0912af2d65439f9f816c6aa00e9a56">tempest-VolumesActionsTest-396564338-project-member</nova:user>
Aug 17 20:19:57 user nova-compute[72815]:         <nova:project uuid="7c884a816adc40bf9932e18058380156">tempest-VolumesActionsTest-396564338</nova:project>
Aug 17 20:19:57 user nova-compute[72815]:       </nova:owner>
Aug 17 20:19:57 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:19:57 user nova-compute[72815]:       <nova:ports>
Aug 17 20:19:57 user nova-compute[72815]:         <nova:port uuid="5127c14c-89b2-4b72-baae-0d530cb06de6">
Aug 17 20:19:57 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 20:19:57 user nova-compute[72815]:         </nova:port>
Aug 17 20:19:57 user nova-compute[72815]:       </nova:ports>
Aug 17 20:19:57 user nova-compute[72815]:     </nova:instance>
Aug 17 20:19:57 user nova-compute[72815]:   </metadata>
Aug 17 20:19:57 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:19:57 user nova-compute[72815]:     <system>
Aug 17 20:19:57 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:19:57 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:19:57 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:19:57 user nova-compute[72815]:       <entry name="serial">d73a930e-2c4c-42d4-a126-dd6a04d4dbe6</entry>
Aug 17 20:19:57 user nova-compute[72815]:       <entry name="uuid">d73a930e-2c4c-42d4-a126-dd6a04d4dbe6</entry>
Aug 17 20:19:57 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:19:57 user nova-compute[72815]:     </system>
Aug 17 20:19:57 user nova-compute[72815]:   </sysinfo>
Aug 17 20:19:57 user nova-compute[72815]:   <os>
Aug 17 20:19:57 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:19:57 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:19:57 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:19:57 user nova-compute[72815]:   </os>
Aug 17 20:19:57 user nova-compute[72815]:   <features>
Aug 17 20:19:57 user nova-compute[72815]:     <acpi/>
Aug 17 20:19:57 user nova-compute[72815]:     <apic/>
Aug 17 20:19:57 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:19:57 user nova-compute[72815]:   </features>
Aug 17 20:19:57 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:19:57 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:19:57 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:19:57 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:19:57 user nova-compute[72815]:   </clock>
Aug 17 20:19:57 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:19:57 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:19:57 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:19:57 user nova-compute[72815]:   </cpu>
Aug 17 20:19:57 user nova-compute[72815]:   <devices>
Aug 17 20:19:57 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:19:57 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:19:57 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk"/>
Aug 17 20:19:57 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:19:57 user nova-compute[72815]:     </disk>
Aug 17 20:19:57 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:19:57 user nova-compute[72815]:       <mac address="fa:16:3e:95:4b:01"/>
Aug 17 20:19:57 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:19:57 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:19:57 user nova-compute[72815]:       <target dev="tap5127c14c-89"/>
Aug 17 20:19:57 user nova-compute[72815]:     </interface>
Aug 17 20:19:57 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:19:57 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/console.log" append="off"/>
Aug 17 20:19:57 user nova-compute[72815]:     </serial>
Aug 17 20:19:57 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:19:57 user nova-compute[72815]:     <video>
Aug 17 20:19:57 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:19:57 user nova-compute[72815]:     </video>
Aug 17 20:19:57 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:19:57 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:19:57 user nova-compute[72815]:     </rng>
Aug 17 20:19:57 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:19:57 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:19:57 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:19:57 user nova-compute[72815]:     </memballoon>
Aug 17 20:19:57 user nova-compute[72815]:   </devices>
Aug 17 20:19:57 user nova-compute[72815]: </domain>
Aug 17 20:19:57 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-942346103',display_name='tempest-VolumesActionsTest-instance-942346103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-942346103',id=49,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c884a816adc40bf9932e18058380156',ramdisk_id='',reservation_id='r-n7dliubw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-396564338',owner_user_name='tempest-VolumesActionsTest-396564338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:19:55Z,user_data=None,user_id='5d0912af2d65439f9f816c6aa00e9a56',uuid=d73a930e-2c4c-42d4-a126-dd6a04d4dbe6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5127c14c-89b2-4b72-baae-0d530cb06de6", "address": "fa:16:3e:95:4b:01", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5127c14c-89", "ovs_interfaceid": "5127c14c-89b2-4b72-baae-0d530cb06de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Converting VIF {"id": "5127c14c-89b2-4b72-baae-0d530cb06de6", "address": "fa:16:3e:95:4b:01", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5127c14c-89", "ovs_interfaceid": "5127c14c-89b2-4b72-baae-0d530cb06de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=5127c14c-89b2-4b72-baae-0d530cb06de6,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5127c14c-89') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG os_vif [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=5127c14c-89b2-4b72-baae-0d530cb06de6,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5127c14c-89') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5127c14c-89, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5127c14c-89, col_values=(('external_ids', {'iface-id': '5127c14c-89b2-4b72-baae-0d530cb06de6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:4b:01', 'vm-uuid': 'd73a930e-2c4c-42d4-a126-dd6a04d4dbe6'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:57 user nova-compute[72815]: INFO os_vif [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=5127c14c-89b2-4b72-baae-0d530cb06de6,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5127c14c-89')
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] No VIF found with MAC fa:16:3e:95:4b:01, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-2a51e145-d1ee-4d29-8a5d-d9f849df5048 req-f16a63ec-80ee-4b42-b690-de82ec6951a8 service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Updated VIF entry in instance network info cache for port 5127c14c-89b2-4b72-baae-0d530cb06de6. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-2a51e145-d1ee-4d29-8a5d-d9f849df5048 req-f16a63ec-80ee-4b42-b690-de82ec6951a8 service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Updating instance_info_cache with network_info: [{"id": "5127c14c-89b2-4b72-baae-0d530cb06de6", "address": "fa:16:3e:95:4b:01", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5127c14c-89", "ovs_interfaceid": "5127c14c-89b2-4b72-baae-0d530cb06de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:19:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-2a51e145-d1ee-4d29-8a5d-d9f849df5048 req-f16a63ec-80ee-4b42-b690-de82ec6951a8 service nova] Releasing lock "refresh_cache-d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "478d6d23-d32e-4dc7-a6ce-88fc378f5536" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "478d6d23-d32e-4dc7-a6ce-88fc378f5536" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG nova.compute.manager [req-c2dbfdee-1d46-4966-a23e-c79b0a773983 req-f0d01f9a-7b12-4fb6-9021-95565b096c79 service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Received event network-vif-plugged-5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c2dbfdee-1d46-4966-a23e-c79b0a773983 req-f0d01f9a-7b12-4fb6-9021-95565b096c79 service nova] Acquiring lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c2dbfdee-1d46-4966-a23e-c79b0a773983 req-f0d01f9a-7b12-4fb6-9021-95565b096c79 service nova] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c2dbfdee-1d46-4966-a23e-c79b0a773983 req-f0d01f9a-7b12-4fb6-9021-95565b096c79 service nova] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG nova.compute.manager [req-c2dbfdee-1d46-4966-a23e-c79b0a773983 req-f0d01f9a-7b12-4fb6-9021-95565b096c79 service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] No waiting events found dispatching network-vif-plugged-5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:19:59 user nova-compute[72815]: WARNING nova.compute.manager [req-c2dbfdee-1d46-4966-a23e-c79b0a773983 req-f0d01f9a-7b12-4fb6-9021-95565b096c79 service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Received unexpected event network-vif-plugged-5127c14c-89b2-4b72-baae-0d530cb06de6 for instance with vm_state building and task_state spawning.
Aug 17 20:19:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:19:59 user nova-compute[72815]: INFO nova.compute.claims [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Claim successful on node user
Aug 17 20:19:59 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:19:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:00 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:20:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:20:00 user nova-compute[72815]: INFO nova.virt.block_device [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Booting with volume 9cb23620-be60-47b9-8f9c-71238a658836 at /dev/vda
Aug 17 20:20:00 user nova-compute[72815]: DEBUG nova.policy [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '577ed0692a254a2fbd518e258563447f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78ad2cbee8e4db892ab66d619e0e42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG os_brick.utils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce609f7-467f-4ba6-84bf-181a6467f8c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3de544-3600-498e-ba2b-f12acab35d4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[de430e0e-a1c9-45f3-baee-b2d2dbae6677]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e290cb4-5d11-49d0-823b-9f63f1dc7be5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:20:00 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:20:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93fba2c-4cb5-4777-9441-9173c2049d4b]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG os_brick.utils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Updating existing volume attachment record: db8f016f-0dd0-40e8-9895-343a51593624 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:20:00 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Successfully created port: e48f886f-dd82-48d3-b926-7062669ffef4 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-4135d86e-f0f0-46d8-82c3-7929f4d99515 req-84615126-f12f-492a-91dc-3f7cdcfe2c9a service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Received event network-vif-plugged-5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4135d86e-f0f0-46d8-82c3-7929f4d99515 req-84615126-f12f-492a-91dc-3f7cdcfe2c9a service nova] Acquiring lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4135d86e-f0f0-46d8-82c3-7929f4d99515 req-84615126-f12f-492a-91dc-3f7cdcfe2c9a service nova] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-4135d86e-f0f0-46d8-82c3-7929f4d99515 req-84615126-f12f-492a-91dc-3f7cdcfe2c9a service nova] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-4135d86e-f0f0-46d8-82c3-7929f4d99515 req-84615126-f12f-492a-91dc-3f7cdcfe2c9a service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] No waiting events found dispatching network-vif-plugged-5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:20:01 user nova-compute[72815]: WARNING nova.compute.manager [req-4135d86e-f0f0-46d8-82c3-7929f4d99515 req-84615126-f12f-492a-91dc-3f7cdcfe2c9a service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Received unexpected event network-vif-plugged-5127c14c-89b2-4b72-baae-0d530cb06de6 for instance with vm_state building and task_state spawning.
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303601.7110064, d73a930e-2c4c-42d4-a126-dd6a04d4dbe6 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:20:01 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] VM Resumed (Lifecycle Event)
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:20:01 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Instance spawned successfully.
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Successfully updated port: e48f886f-dd82-48d3-b926-7062669ffef4 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "refresh_cache-478d6d23-d32e-4dc7-a6ce-88fc378f5536" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquired lock "refresh_cache-478d6d23-d32e-4dc7-a6ce-88fc378f5536" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:20:01 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303601.7138, d73a930e-2c4c-42d4-a126-dd6a04d4dbe6 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:20:01 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] VM Started (Lifecycle Event)
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-115f435f-a0cb-42a5-b3f5-41241527ae56 req-029052fe-ca55-4186-94cf-e77e70f123ad service nova] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Received event network-changed-e48f886f-dd82-48d3-b926-7062669ffef4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.compute.manager [req-115f435f-a0cb-42a5-b3f5-41241527ae56 req-029052fe-ca55-4186-94cf-e77e70f123ad service nova] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Refreshing instance network info cache due to event network-changed-e48f886f-dd82-48d3-b926-7062669ffef4. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-115f435f-a0cb-42a5-b3f5-41241527ae56 req-029052fe-ca55-4186-94cf-e77e70f123ad service nova] Acquiring lock "refresh_cache-478d6d23-d32e-4dc7-a6ce-88fc378f5536" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:20:01 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:20:01 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:20:02 user nova-compute[72815]: INFO nova.compute.manager [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 17 20:20:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:20:02 user nova-compute[72815]: INFO nova.compute.manager [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Took 7.90 seconds to build instance.
Aug 17 20:20:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-488d148e-8375-4e8f-b327-55bac6a5c693 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.043s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:20:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:20:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:02 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Updating instance_info_cache with network_info: [{"id": "e48f886f-dd82-48d3-b926-7062669ffef4", "address": "fa:16:3e:2d:20:3a", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48f886f-dd", "ovs_interfaceid": "e48f886f-dd82-48d3-b926-7062669ffef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:20:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Releasing lock "refresh_cache-478d6d23-d32e-4dc7-a6ce-88fc378f5536" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:20:02 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Instance network_info: |[{"id": "e48f886f-dd82-48d3-b926-7062669ffef4", "address": "fa:16:3e:2d:20:3a", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48f886f-dd", "ovs_interfaceid": "e48f886f-dd82-48d3-b926-7062669ffef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:20:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-115f435f-a0cb-42a5-b3f5-41241527ae56 req-029052fe-ca55-4186-94cf-e77e70f123ad service nova] Acquired lock "refresh_cache-478d6d23-d32e-4dc7-a6ce-88fc378f5536" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:20:02 user nova-compute[72815]: DEBUG nova.network.neutron [req-115f435f-a0cb-42a5-b3f5-41241527ae56 req-029052fe-ca55-4186-94cf-e77e70f123ad service nova] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Refreshing network info cache for port e48f886f-dd82-48d3-b926-7062669ffef4 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:20:03 user nova-compute[72815]: DEBUG nova.network.neutron [req-115f435f-a0cb-42a5-b3f5-41241527ae56 req-029052fe-ca55-4186-94cf-e77e70f123ad service nova] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Updated VIF entry in instance network info cache for port e48f886f-dd82-48d3-b926-7062669ffef4. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:20:03 user nova-compute[72815]: DEBUG nova.network.neutron [req-115f435f-a0cb-42a5-b3f5-41241527ae56 req-029052fe-ca55-4186-94cf-e77e70f123ad service nova] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Updating instance_info_cache with network_info: [{"id": "e48f886f-dd82-48d3-b926-7062669ffef4", "address": "fa:16:3e:2d:20:3a", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48f886f-dd", "ovs_interfaceid": "e48f886f-dd82-48d3-b926-7062669ffef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:20:03 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-115f435f-a0cb-42a5-b3f5-41241527ae56 req-029052fe-ca55-4186-94cf-e77e70f123ad service nova] Releasing lock "refresh_cache-478d6d23-d32e-4dc7-a6ce-88fc378f5536" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:20:06 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:20:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 20:20:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] There are 0 instances to clean {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 20:20:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.volume.cinder [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Update attachment failed for attachment db8f016f-0dd0-40e8-9895-343a51593624. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9cb23620-be60-47b9-8f9c-71238a658836 because of JDSS internal system error 1:Scstadmin Error:
Aug 17 20:20:14 user nova-compute[72815]: Collecting current configuration:
Aug 17 20:20:14 user nova-compute[72815]: FATAL: Received the following error:
Aug 17 20:20:14 user nova-compute[72815]:         handlerAttributes(): Unable to read handler attribute '21aea5610f0f5cce': No such file or directory
Aug 17 20:20:14 user nova-compute[72815]: :/var/nasexe/SCST/scstadmin -set_dev_attr e06c77a2fd3e71ed -attributes prod_id=Storage -noprompt..).). (HTTP 500) (Request-ID: req-b3c58d52-9d75-4c4f-a901-d37cf1e6c0a8) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9cb23620-be60-47b9-8f9c-71238a658836 because of JDSS internal system error 1:Scstadmin Error: 
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9cb23620-be60-47b9-8f9c-71238a658836 because of JDSS internal system error 1:Scstadmin Error:
Aug 17 20:20:14 user nova-compute[72815]: Collecting current configuration:
Aug 17 20:20:14 user nova-compute[72815]: FATAL: Received the following error:
Aug 17 20:20:14 user nova-compute[72815]:         handlerAttributes(): Unable to read handler attribute '21aea5610f0f5cce': No such file or directory
Aug 17 20:20:14 user nova-compute[72815]: :/var/nasexe/SCST/scstadmin -set_dev_attr e06c77a2fd3e71ed -attributes prod_id=Storage -noprompt..).). (HTTP 500) (Request-ID: req-b3c58d52-9d75-4c4f-a901-d37cf1e6c0a8)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Traceback (most recent call last):
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     driver_block_device.attach_block_devices(
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     _log_and_attach(device)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     bdm.attach(*attach_args, **attach_kwargs)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     ret_val = method(obj, context, *args, **kwargs)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     self._do_attach(context, instance, volume, volume_api,
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     self._volume_attach(context, volume, connector, instance,
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     connection_info = volume_api.attachment_update(
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     res = method(self, ctx, *args, **kwargs)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     with excutils.save_and_reraise_exception():
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     self.force_reraise()
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     raise self.value
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     return method.func(obj, *args, **kwargs)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     resp = self._update('/attachments/%s' % id, body)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     return self.request(url, method, **kwargs)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]     raise exceptions.from_response(resp, body)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9cb23620-be60-47b9-8f9c-71238a658836 because of JDSS internal system error 1:Scstadmin Error:
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Collecting current configuration:
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] 
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] FATAL: Received the following error:
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] 
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536]         handlerAttributes(): Unable to read handler attribute '21aea5610f0f5cce': No such file or directory
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] 
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] :/var/nasexe/SCST/scstadmin -set_dev_attr e06c77a2fd3e71ed -attributes prod_id=Storage -noprompt..).). (HTTP 500) (Request-ID: req-b3c58d52-9d75-4c4f-a901-d37cf1e6c0a8)
Aug 17 20:20:14 user nova-compute[72815]: ERROR nova.compute.manager [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] 
Aug 17 20:20:14 user nova-compute[72815]: DEBUG nova.compute.claims [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Aborting claim: <nova.compute.claims.Claim object at 0x7f39941ff940> {{(pid=72815) abort /opt/stack/nova/nova/compute/claims.py:84}}
Aug 17 20:20:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:20:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.264s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Build of instance 478d6d23-d32e-4dc7-a6ce-88fc378f5536 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9cb23620-be60-47b9-8f9c-71238a658836 because of JDSS internal system error 1:Scstadmin Error:
Aug 17 20:20:15 user nova-compute[72815]: Collecting current configuration:
Aug 17 20:20:15 user nova-compute[72815]: FATAL: Received the following error:
Aug 17 20:20:15 user nova-compute[72815]:         handlerAttributes(): Unable to read handler attribute '21aea5610f0f5cce': No such file or directory
Aug 17 20:20:15 user nova-compute[72815]: :/var/nasexe/SCST/scstadmin -set_dev_attr e06c77a2fd3e71ed -attributes prod_id=Storage -noprompt..).). (HTTP 500) (Request-ID: req-b3c58d52-9d75-4c4f-a901-d37cf1e6c0a8) {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2644}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.compute.utils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Build of instance 478d6d23-d32e-4dc7-a6ce-88fc378f5536 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9cb23 {{(pid=72815) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Aug 17 20:20:15 user nova-compute[72815]: ERROR nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Build of instance 478d6d23-d32e-4dc7-a6ce-88fc378f5536 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9cb23620-be60-47b9-8f9c-71238a658836 because of JDSS internal system error 1:Scstadmin Error:
Aug 17 20:20:15 user nova-compute[72815]: Collecting current configuration:
Aug 17 20:20:15 user nova-compute[72815]: FATAL: Received the following error:
Aug 17 20:20:15 user nova-compute[72815]:         handlerAttributes(): Unable to read handler attribute '21aea5610f0f5cce': No such file or directory
Aug 17 20:20:15 user nova-compute[72815]: :/var/nasexe/SCST/scstadmin -set_dev_attr e06c77a2fd3e71ed -attributes prod_id=Storage -noprompt..).). (HTTP 500) (Request-ID: req-b3c58d52-9d75-4c4f-a901-d37cf1e6c0a8): nova.exception.BuildAbortException: Build of instance 478d6d23-d32e-4dc7-a6ce-88fc378f5536 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9cb23620-be60-47b9-8f9c-71238a658836 because of JDSS internal system error 1:Scstadmin Error: 
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Unplugging VIFs for instance {{(pid=72815) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2980}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-836482713',display_name='tempest-TestVolumeBootPattern-server-836482713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-836482713',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpfGoBrYuqmPWFRwR9dBH3etfjmi+9O1crWczyHc9MI1VhAR15OT7t+WrT1HrpsEV9/2nWGMdeUlL2wsj6uonqU5hD2QzwNh0c4wK0+zMM0byFWbIkK5vSFxWEBfwR78Q==',key_name='tempest-TestVolumeBootPattern-525261020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-dl91lg7z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:20:00Z,user_data=None,user_id='577ed0692a254a2fbd518e258563447f',uuid=478d6d23-d32e-4dc7-a6ce-88fc378f5536,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e48f886f-dd82-48d3-b926-7062669ffef4", "address": "fa:16:3e:2d:20:3a", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48f886f-dd", "ovs_interfaceid": "e48f886f-dd82-48d3-b926-7062669ffef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "e48f886f-dd82-48d3-b926-7062669ffef4", "address": "fa:16:3e:2d:20:3a", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48f886f-dd", "ovs_interfaceid": "e48f886f-dd82-48d3-b926-7062669ffef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:20:3a,bridge_name='br-int',has_traffic_filtering=True,id=e48f886f-dd82-48d3-b926-7062669ffef4,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48f886f-dd') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG os_vif [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:20:3a,bridge_name='br-int',has_traffic_filtering=True,id=e48f886f-dd82-48d3-b926-7062669ffef4,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48f886f-dd') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape48f886f-dd, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:20:15 user nova-compute[72815]: INFO os_vif [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:20:3a,bridge_name='br-int',has_traffic_filtering=True,id=e48f886f-dd82-48d3-b926-7062669ffef4,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48f886f-dd')
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Unplugged VIFs for instance {{(pid=72815) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3016}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.network.neutron [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:20:15 user nova-compute[72815]: INFO nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Took 0.61 seconds to deallocate network for instance.
Aug 17 20:20:15 user nova-compute[72815]: DEBUG nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Detaching volume: 9cb23620-be60-47b9-8f9c-71238a658836 {{(pid=72815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3208}}
Aug 17 20:20:15 user nova-compute[72815]: INFO nova.compute.manager [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Detaching volume 9cb23620-be60-47b9-8f9c-71238a658836
Aug 17 20:20:16 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 478d6d23-d32e-4dc7-a6ce-88fc378f5536] Skipping driver_detach during remote rebuild. {{(pid=72815) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Aug 17 20:20:16 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Deleted allocations for instance 478d6d23-d32e-4dc7-a6ce-88fc378f5536
Aug 17 20:20:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-5dc9e1f9-20c1-4789-9263-60b90e0a7399 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "478d6d23-d32e-4dc7-a6ce-88fc378f5536" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.893s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:20:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:20:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 48168dd3-a054-49e9-af8e-3d373378f87a {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid 20a2c899-49ce-4118-be88-4be69dc205fb {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Triggering sync for uuid d73a930e-2c4c-42d4-a126-dd6a04d4dbe6 {{(pid=72815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "48168dd3-a054-49e9-af8e-3d373378f87a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "48168dd3-a054-49e9-af8e-3d373378f87a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "48168dd3-a054-49e9-af8e-3d373378f87a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:20:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:40 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:20:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:20:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:20:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:20:40 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:20:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:20:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:20:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:20:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:20:41 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:20:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:20:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:20:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:20:41 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:20:42 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:20:42 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:20:42 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=8162MB free_disk=25.309383392333984GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:20:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:20:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:20:42 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 48168dd3-a054-49e9-af8e-3d373378f87a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:20:42 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 20a2c899-49ce-4118-be88-4be69dc205fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:20:42 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance d73a930e-2c4c-42d4-a126-dd6a04d4dbe6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:20:42 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:20:42 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:20:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:42 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:20:42 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:20:42 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:20:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:20:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:47 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:20:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:20:47 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 20:20:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:20:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:20:47 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:20:47 user nova-compute[72815]: DEBUG nova.objects.instance [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lazy-loading 'info_cache' on Instance uuid 48168dd3-a054-49e9-af8e-3d373378f87a {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:20:48 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updating instance_info_cache with network_info: [{"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:20:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:20:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:20:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:20:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:20:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:20:50 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:20:50 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:20:51 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:20:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:20:53 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:20:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:20:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:01 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a30258c-3725-4ef5-92de-9c1855e660fd req-75b1ee35-d6ec-4a59-8689-3356cc926b39 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-changed-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-3a30258c-3725-4ef5-92de-9c1855e660fd req-75b1ee35-d6ec-4a59-8689-3356cc926b39 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Refreshing instance network info cache due to event network-changed-1645a7ee-c867-417f-b297-2122fd346fc4. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a30258c-3725-4ef5-92de-9c1855e660fd req-75b1ee35-d6ec-4a59-8689-3356cc926b39 service nova] Acquiring lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a30258c-3725-4ef5-92de-9c1855e660fd req-75b1ee35-d6ec-4a59-8689-3356cc926b39 service nova] Acquired lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG nova.network.neutron [req-3a30258c-3725-4ef5-92de-9c1855e660fd req-75b1ee35-d6ec-4a59-8689-3356cc926b39 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Refreshing network info cache for port 1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "48168dd3-a054-49e9-af8e-3d373378f87a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "48168dd3-a054-49e9-af8e-3d373378f87a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:04 user nova-compute[72815]: INFO nova.compute.manager [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Terminating instance
Aug 17 20:21:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:21:05 user nova-compute[72815]: INFO nova.compute.claims [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Claim successful on node user
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-d854b5c4-b1cf-4f46-a50c-e4ac413d87a6 req-15bbdc74-4115-4a48-a8b2-426eaf451c56 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-vif-unplugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d854b5c4-b1cf-4f46-a50c-e4ac413d87a6 req-15bbdc74-4115-4a48-a8b2-426eaf451c56 service nova] Acquiring lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d854b5c4-b1cf-4f46-a50c-e4ac413d87a6 req-15bbdc74-4115-4a48-a8b2-426eaf451c56 service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-d854b5c4-b1cf-4f46-a50c-e4ac413d87a6 req-15bbdc74-4115-4a48-a8b2-426eaf451c56 service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-d854b5c4-b1cf-4f46-a50c-e4ac413d87a6 req-15bbdc74-4115-4a48-a8b2-426eaf451c56 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] No waiting events found dispatching network-vif-unplugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.compute.manager [req-d854b5c4-b1cf-4f46-a50c-e4ac413d87a6 req-15bbdc74-4115-4a48-a8b2-426eaf451c56 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-vif-unplugged-1645a7ee-c867-417f-b297-2122fd346fc4 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:05 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Instance destroyed successfully.
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.objects.instance [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lazy-loading 'resources' on Instance uuid 48168dd3-a054-49e9-af8e-3d373378f87a {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-484348863',display_name='tempest-TestVolumeBootPattern-server-484348863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-484348863',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpfGoBrYuqmPWFRwR9dBH3etfjmi+9O1crWczyHc9MI1VhAR15OT7t+WrT1HrpsEV9/2nWGMdeUlL2wsj6uonqU5hD2QzwNh0c4wK0+zMM0byFWbIkK5vSFxWEBfwR78Q==',key_name='tempest-TestVolumeBootPattern-525261020',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a78ad2cbee8e4db892ab66d619e0e42e',ramdisk_id='',reservation_id='r-q2x08e7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-781314261',owner_user_name='tempest-TestVolumeBootPattern-781314261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:18:06Z,user_data=None,user_id='577ed0692a254a2fbd518e258563447f',uuid=48168dd3-a054-49e9-af8e-3d373378f87a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converting VIF {"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:ed:2b,bridge_name='br-int',has_traffic_filtering=True,id=1645a7ee-c867-417f-b297-2122fd346fc4,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1645a7ee-c8') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_vif [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:ed:2b,bridge_name='br-int',has_traffic_filtering=True,id=1645a7ee-c867-417f-b297-2122fd346fc4,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1645a7ee-c8') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1645a7ee-c8, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:05 user nova-compute[72815]: INFO os_vif [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:ed:2b,bridge_name='br-int',has_traffic_filtering=True,id=1645a7ee-c867-417f-b297-2122fd346fc4,network=Network(7a19f559-756f-4dca-8c91-60f33c1ea142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1645a7ee-c8')
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yivEHohA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:21:05 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[611912c9-8ba6-4072-94df-bc5b615e7c1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[77733531-bf72-4ccc-a2a5-897ebeb74cae]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:21:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 (non-flash)
Aug 17 20:21:05 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994742cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27'): ({'sdb'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Removing single pathed devices sdb {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffff35b3-6802-4253-a84a-0aef6705c0fe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[99334846-add7-41d9-b706-5f833d753444]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Flushing IO for device /dev/sdb {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.027s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f813c0-8a01-448f-a012-89068c9bbda8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.compute.manager [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG nova.network.neutron [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d9db0c-d577-4901-8c69-4dff7056b17b]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:21:05 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG nova.network.neutron [req-3a30258c-3725-4ef5-92de-9c1855e660fd req-75b1ee35-d6ec-4a59-8689-3356cc926b39 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updated VIF entry in instance network info cache for port 1645a7ee-c867-417f-b297-2122fd346fc4. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG nova.network.neutron [req-3a30258c-3725-4ef5-92de-9c1855e660fd req-75b1ee35-d6ec-4a59-8689-3356cc926b39 service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updating instance_info_cache with network_info: [{"id": "1645a7ee-c867-417f-b297-2122fd346fc4", "address": "fa:16:3e:52:ed:2b", "network": {"id": "7a19f559-756f-4dca-8c91-60f33c1ea142", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-435198911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78ad2cbee8e4db892ab66d619e0e42e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1645a7ee-c8", "ovs_interfaceid": "1645a7ee-c867-417f-b297-2122fd346fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG nova.policy [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93c31aa201164e58b631421aeb1df52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584bbd9ac504db78dd5bf1f5ce8a1f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.121s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7bfb9f-6856-4f16-b5f8-e08775bb7ca5]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3a30258c-3725-4ef5-92de-9c1855e660fd req-75b1ee35-d6ec-4a59-8689-3356cc926b39 service nova] Releasing lock "refresh_cache-48168dd3-a054-49e9-af8e-3d373378f87a" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:21:06 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[298f96cc-2077-4bc8-9a32-a54e2ac302b2]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260]
Aug 17 20:21:06 user nova-compute[72815]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27, portal: 172.16.0.220,3260] successful.
Aug 17 20:21:06 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ddc1c66-aa99-4dcb-ae2a-8cb420d03d27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed48d11-13cc-4278-97f9-0e9acb518e7a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.472s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] <== disconnect_volume: return (476ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:21:06 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Deleting instance files /opt/stack/data/nova/instances/48168dd3-a054-49e9-af8e-3d373378f87a_del
Aug 17 20:21:06 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Deletion of /opt/stack/data/nova/instances/48168dd3-a054-49e9-af8e-3d373378f87a_del complete
Aug 17 20:21:06 user nova-compute[72815]: INFO nova.compute.manager [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Took 1.51 seconds to destroy the instance on the hypervisor.
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:21:06 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Creating image(s)
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "/opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "/opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "/opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.194s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.207s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk 1073741824" returned: 0 in 0.131s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:06 user nova-compute[72815]: DEBUG nova.network.neutron [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Successfully created port: b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Cannot resize image /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.objects.instance [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lazy-loading 'migration_context' on Instance uuid 35d7e1a6-06e2-48e8-babb-af7b31d50d77 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Ensure instance console log exists: /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:07 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Took 1.17 seconds to deallocate network for instance.
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Acquiring lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] No waiting events found dispatching network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:21:07 user nova-compute[72815]: WARNING nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received unexpected event network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 for instance with vm_state active and task_state deleting.
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Acquiring lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] No waiting events found dispatching network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:21:07 user nova-compute[72815]: WARNING nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received unexpected event network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 for instance with vm_state active and task_state deleting.
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Acquiring lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] No waiting events found dispatching network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:21:07 user nova-compute[72815]: WARNING nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received unexpected event network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 for instance with vm_state active and task_state deleting.
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-vif-unplugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Acquiring lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] No waiting events found dispatching network-vif-unplugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-vif-unplugged-1645a7ee-c867-417f-b297-2122fd346fc4 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Acquiring lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] Lock "48168dd3-a054-49e9-af8e-3d373378f87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] No waiting events found dispatching network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:21:07 user nova-compute[72815]: WARNING nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received unexpected event network-vif-plugged-1645a7ee-c867-417f-b297-2122fd346fc4 for instance with vm_state active and task_state deleting.
Aug 17 20:21:07 user nova-compute[72815]: DEBUG nova.compute.manager [req-43943336-8941-4ca3-95a9-1ac4be150353 req-af450b42-2978-4ebd-bf6e-fdd8539d37ed service nova] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Received event network-vif-deleted-1645a7ee-c867-417f-b297-2122fd346fc4 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Successfully updated port: b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "refresh_cache-35d7e1a6-06e2-48e8-babb-af7b31d50d77" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquired lock "refresh_cache-35d7e1a6-06e2-48e8-babb-af7b31d50d77" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-f59d6ed6-2a63-4a33-b174-db007dbb1322 req-be07e71f-1fc5-40d7-9f09-eeca93b6d603 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Received event network-changed-b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.compute.manager [req-f59d6ed6-2a63-4a33-b174-db007dbb1322 req-be07e71f-1fc5-40d7-9f09-eeca93b6d603 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Refreshing instance network info cache due to event network-changed-b3771f5f-ac74-4ab4-9631-9eab589f24ae. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f59d6ed6-2a63-4a33-b174-db007dbb1322 req-be07e71f-1fc5-40d7-9f09-eeca93b6d603 service nova] Acquiring lock "refresh_cache-35d7e1a6-06e2-48e8-babb-af7b31d50d77" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:21:08 user nova-compute[72815]: INFO nova.compute.manager [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Took 0.98 seconds to detach 1 volumes for instance.
Aug 17 20:21:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.network.neutron [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Updating instance_info_cache with network_info: [{"id": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "address": "fa:16:3e:b7:d0:cd", "network": {"id": "01c030f2-8e11-48aa-8b7c-bbf377486499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1379663334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a584bbd9ac504db78dd5bf1f5ce8a1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3771f5f-ac", "ovs_interfaceid": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Releasing lock "refresh_cache-35d7e1a6-06e2-48e8-babb-af7b31d50d77" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.compute.manager [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Instance network_info: |[{"id": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "address": "fa:16:3e:b7:d0:cd", "network": {"id": "01c030f2-8e11-48aa-8b7c-bbf377486499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1379663334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a584bbd9ac504db78dd5bf1f5ce8a1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3771f5f-ac", "ovs_interfaceid": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f59d6ed6-2a63-4a33-b174-db007dbb1322 req-be07e71f-1fc5-40d7-9f09-eeca93b6d603 service nova] Acquired lock "refresh_cache-35d7e1a6-06e2-48e8-babb-af7b31d50d77" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.network.neutron [req-f59d6ed6-2a63-4a33-b174-db007dbb1322 req-be07e71f-1fc5-40d7-9f09-eeca93b6d603 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Refreshing network info cache for port b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Start _get_guest_xml network_info=[{"id": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "address": "fa:16:3e:b7:d0:cd", "network": {"id": "01c030f2-8e11-48aa-8b7c-bbf377486499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1379663334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a584bbd9ac504db78dd5bf1f5ce8a1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3771f5f-ac", "ovs_interfaceid": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:21:08 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:21:08 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1516825561',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1516825561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1516825',id=51,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc9Gm74ZrcKoEilBAjz2zI+7e7xlS9Qnh4jkcsdjT8anTmidILXWAnEXQ85q9iJQ54521RJoDojPE1PWTELm86nZ72pLwbqLQoK9OveNgYKQfZKfN5VzZr5fn5oKNWnOQ==',key_name='tempest-keypair-1573598965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a584bbd9ac504db78dd5bf1f5ce8a1f2',ramdisk_id='',reservation_id='r-edtlrkcc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1412262998',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c31aa201164e58b631421aeb1df52e',uuid=35d7e1a6-06e2-48e8-babb-af7b31d50d77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "address": "fa:16:3e:b7:d0:cd", "network": {"id": "01c030f2-8e11-48aa-8b7c-bbf377486499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1379663334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a584bbd9ac504db78dd5bf1f5ce8a1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3771f5f-ac", "ovs_interfaceid": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Converting VIF {"id": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "address": "fa:16:3e:b7:d0:cd", "network": {"id": "01c030f2-8e11-48aa-8b7c-bbf377486499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1379663334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a584bbd9ac504db78dd5bf1f5ce8a1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3771f5f-ac", "ovs_interfaceid": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=b3771f5f-ac74-4ab4-9631-9eab589f24ae,network=Network(01c030f2-8e11-48aa-8b7c-bbf377486499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3771f5f-ac') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.objects.instance [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lazy-loading 'pci_devices' on Instance uuid 35d7e1a6-06e2-48e8-babb-af7b31d50d77 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:21:08 user nova-compute[72815]:   <uuid>35d7e1a6-06e2-48e8-babb-af7b31d50d77</uuid>
Aug 17 20:21:08 user nova-compute[72815]:   <name>instance-00000033</name>
Aug 17 20:21:08 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:21:08 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:21:08 user nova-compute[72815]:   <metadata>
Aug 17 20:21:08 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:21:08 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:21:08 user nova-compute[72815]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1516825561</nova:name>
Aug 17 20:21:08 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:21:08</nova:creationTime>
Aug 17 20:21:08 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:21:08 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:21:08 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:21:08 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:21:08 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:21:08 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:21:08 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:21:08 user nova-compute[72815]:       <nova:owner>
Aug 17 20:21:08 user nova-compute[72815]:         <nova:user uuid="93c31aa201164e58b631421aeb1df52e">tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member</nova:user>
Aug 17 20:21:08 user nova-compute[72815]:         <nova:project uuid="a584bbd9ac504db78dd5bf1f5ce8a1f2">tempest-TestServerVolumeAttachScenarioOldVersion-1412262998</nova:project>
Aug 17 20:21:08 user nova-compute[72815]:       </nova:owner>
Aug 17 20:21:08 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:21:08 user nova-compute[72815]:       <nova:ports>
Aug 17 20:21:08 user nova-compute[72815]:         <nova:port uuid="b3771f5f-ac74-4ab4-9631-9eab589f24ae">
Aug 17 20:21:08 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 20:21:08 user nova-compute[72815]:         </nova:port>
Aug 17 20:21:08 user nova-compute[72815]:       </nova:ports>
Aug 17 20:21:08 user nova-compute[72815]:     </nova:instance>
Aug 17 20:21:08 user nova-compute[72815]:   </metadata>
Aug 17 20:21:08 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:21:08 user nova-compute[72815]:     <system>
Aug 17 20:21:08 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:21:08 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:21:08 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:21:08 user nova-compute[72815]:       <entry name="serial">35d7e1a6-06e2-48e8-babb-af7b31d50d77</entry>
Aug 17 20:21:08 user nova-compute[72815]:       <entry name="uuid">35d7e1a6-06e2-48e8-babb-af7b31d50d77</entry>
Aug 17 20:21:08 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:21:08 user nova-compute[72815]:     </system>
Aug 17 20:21:08 user nova-compute[72815]:   </sysinfo>
Aug 17 20:21:08 user nova-compute[72815]:   <os>
Aug 17 20:21:08 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:21:08 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:21:08 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:21:08 user nova-compute[72815]:   </os>
Aug 17 20:21:08 user nova-compute[72815]:   <features>
Aug 17 20:21:08 user nova-compute[72815]:     <acpi/>
Aug 17 20:21:08 user nova-compute[72815]:     <apic/>
Aug 17 20:21:08 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:21:08 user nova-compute[72815]:   </features>
Aug 17 20:21:08 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:21:08 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:21:08 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:21:08 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:21:08 user nova-compute[72815]:   </clock>
Aug 17 20:21:08 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:21:08 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:21:08 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:21:08 user nova-compute[72815]:   </cpu>
Aug 17 20:21:08 user nova-compute[72815]:   <devices>
Aug 17 20:21:08 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:21:08 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:21:08 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk"/>
Aug 17 20:21:08 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:21:08 user nova-compute[72815]:     </disk>
Aug 17 20:21:08 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:21:08 user nova-compute[72815]:       <mac address="fa:16:3e:b7:d0:cd"/>
Aug 17 20:21:08 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:21:08 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:21:08 user nova-compute[72815]:       <target dev="tapb3771f5f-ac"/>
Aug 17 20:21:08 user nova-compute[72815]:     </interface>
Aug 17 20:21:08 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:21:08 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/console.log" append="off"/>
Aug 17 20:21:08 user nova-compute[72815]:     </serial>
Aug 17 20:21:08 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:21:08 user nova-compute[72815]:     <video>
Aug 17 20:21:08 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:21:08 user nova-compute[72815]:     </video>
Aug 17 20:21:08 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:21:08 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:21:08 user nova-compute[72815]:     </rng>
Aug 17 20:21:08 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:21:08 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:21:08 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:21:08 user nova-compute[72815]:     </memballoon>
Aug 17 20:21:08 user nova-compute[72815]:   </devices>
Aug 17 20:21:08 user nova-compute[72815]: </domain>
Aug 17 20:21:08 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1516825561',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1516825561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1516825',id=51,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc9Gm74ZrcKoEilBAjz2zI+7e7xlS9Qnh4jkcsdjT8anTmidILXWAnEXQ85q9iJQ54521RJoDojPE1PWTELm86nZ72pLwbqLQoK9OveNgYKQfZKfN5VzZr5fn5oKNWnOQ==',key_name='tempest-keypair-1573598965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a584bbd9ac504db78dd5bf1f5ce8a1f2',ramdisk_id='',reservation_id='r-edtlrkcc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1412262998',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c31aa201164e58b631421aeb1df52e',uuid=35d7e1a6-06e2-48e8-babb-af7b31d50d77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "address": "fa:16:3e:b7:d0:cd", "network": {"id": "01c030f2-8e11-48aa-8b7c-bbf377486499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1379663334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a584bbd9ac504db78dd5bf1f5ce8a1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3771f5f-ac", "ovs_interfaceid": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Converting VIF {"id": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "address": "fa:16:3e:b7:d0:cd", "network": {"id": "01c030f2-8e11-48aa-8b7c-bbf377486499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1379663334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a584bbd9ac504db78dd5bf1f5ce8a1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3771f5f-ac", "ovs_interfaceid": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=b3771f5f-ac74-4ab4-9631-9eab589f24ae,network=Network(01c030f2-8e11-48aa-8b7c-bbf377486499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3771f5f-ac') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG os_vif [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=b3771f5f-ac74-4ab4-9631-9eab589f24ae,network=Network(01c030f2-8e11-48aa-8b7c-bbf377486499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3771f5f-ac') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3771f5f-ac, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3771f5f-ac, col_values=(('external_ids', {'iface-id': 'b3771f5f-ac74-4ab4-9631-9eab589f24ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:d0:cd', 'vm-uuid': '35d7e1a6-06e2-48e8-babb-af7b31d50d77'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:08 user nova-compute[72815]: INFO os_vif [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=b3771f5f-ac74-4ab4-9631-9eab589f24ae,network=Network(01c030f2-8e11-48aa-8b7c-bbf377486499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3771f5f-ac')
Aug 17 20:21:08 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Deleted allocations for instance 48168dd3-a054-49e9-af8e-3d373378f87a
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] No VIF found with MAC fa:16:3e:b7:d0:cd, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:21:08 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-7a16993c-0b14-42bd-9efe-616bef97f207 tempest-TestVolumeBootPattern-781314261 tempest-TestVolumeBootPattern-781314261-project-member] Lock "48168dd3-a054-49e9-af8e-3d373378f87a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.160s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:09 user nova-compute[72815]: DEBUG nova.network.neutron [req-f59d6ed6-2a63-4a33-b174-db007dbb1322 req-be07e71f-1fc5-40d7-9f09-eeca93b6d603 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Updated VIF entry in instance network info cache for port b3771f5f-ac74-4ab4-9631-9eab589f24ae. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:21:09 user nova-compute[72815]: DEBUG nova.network.neutron [req-f59d6ed6-2a63-4a33-b174-db007dbb1322 req-be07e71f-1fc5-40d7-9f09-eeca93b6d603 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Updating instance_info_cache with network_info: [{"id": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "address": "fa:16:3e:b7:d0:cd", "network": {"id": "01c030f2-8e11-48aa-8b7c-bbf377486499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1379663334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a584bbd9ac504db78dd5bf1f5ce8a1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3771f5f-ac", "ovs_interfaceid": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:21:09 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f59d6ed6-2a63-4a33-b174-db007dbb1322 req-be07e71f-1fc5-40d7-9f09-eeca93b6d603 service nova] Releasing lock "refresh_cache-35d7e1a6-06e2-48e8-babb-af7b31d50d77" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:21:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c7ab1e9-0fb7-47e8-b7ab-9a7586efd867 req-d0fc8a31-4dec-4dbd-ad80-0f2a35b17b84 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Received event network-vif-plugged-b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c7ab1e9-0fb7-47e8-b7ab-9a7586efd867 req-d0fc8a31-4dec-4dbd-ad80-0f2a35b17b84 service nova] Acquiring lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c7ab1e9-0fb7-47e8-b7ab-9a7586efd867 req-d0fc8a31-4dec-4dbd-ad80-0f2a35b17b84 service nova] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:10 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-3c7ab1e9-0fb7-47e8-b7ab-9a7586efd867 req-d0fc8a31-4dec-4dbd-ad80-0f2a35b17b84 service nova] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:10 user nova-compute[72815]: DEBUG nova.compute.manager [req-3c7ab1e9-0fb7-47e8-b7ab-9a7586efd867 req-d0fc8a31-4dec-4dbd-ad80-0f2a35b17b84 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] No waiting events found dispatching network-vif-plugged-b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:21:10 user nova-compute[72815]: WARNING nova.compute.manager [req-3c7ab1e9-0fb7-47e8-b7ab-9a7586efd867 req-d0fc8a31-4dec-4dbd-ad80-0f2a35b17b84 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Received unexpected event network-vif-plugged-b3771f5f-ac74-4ab4-9631-9eab589f24ae for instance with vm_state building and task_state spawning.
Aug 17 20:21:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:11 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303672.3360827, 35d7e1a6-06e2-48e8-babb-af7b31d50d77 => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:21:12 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] VM Resumed (Lifecycle Event)
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:21:12 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Instance spawned successfully.
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:21:12 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303672.3400967, 35d7e1a6-06e2-48e8-babb-af7b31d50d77 => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:21:12 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] VM Started (Lifecycle Event)
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:21:12 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:21:12 user nova-compute[72815]: INFO nova.compute.manager [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.compute.manager [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-f5092681-ee12-4aca-a53b-276dff5cd64e req-9bc7d880-6dc8-4c33-849a-30ff3e18441e service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Received event network-vif-plugged-b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f5092681-ee12-4aca-a53b-276dff5cd64e req-9bc7d880-6dc8-4c33-849a-30ff3e18441e service nova] Acquiring lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f5092681-ee12-4aca-a53b-276dff5cd64e req-9bc7d880-6dc8-4c33-849a-30ff3e18441e service nova] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f5092681-ee12-4aca-a53b-276dff5cd64e req-9bc7d880-6dc8-4c33-849a-30ff3e18441e service nova] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:12 user nova-compute[72815]: DEBUG nova.compute.manager [req-f5092681-ee12-4aca-a53b-276dff5cd64e req-9bc7d880-6dc8-4c33-849a-30ff3e18441e service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] No waiting events found dispatching network-vif-plugged-b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:21:12 user nova-compute[72815]: WARNING nova.compute.manager [req-f5092681-ee12-4aca-a53b-276dff5cd64e req-9bc7d880-6dc8-4c33-849a-30ff3e18441e service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Received unexpected event network-vif-plugged-b3771f5f-ac74-4ab4-9631-9eab589f24ae for instance with vm_state building and task_state spawning.
Aug 17 20:21:12 user nova-compute[72815]: INFO nova.compute.manager [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Took 7.25 seconds to build instance.
Aug 17 20:21:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-16c69834-4692-48cc-9d9f-a09016f8291c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.385s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:17 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:20 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303665.5842743, 48168dd3-a054-49e9-af8e-3d373378f87a => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:21:20 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] VM Stopped (Lifecycle Event)
Aug 17 20:21:20 user nova-compute[72815]: DEBUG nova.compute.manager [None req-dfe31aaf-0c55-40c3-93ec-9a3aabed1fd1 None None] [instance: 48168dd3-a054-49e9-af8e-3d373378f87a] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:21:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG nova.objects.instance [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'flavor' on Instance uuid 20a2c899-49ce-4118-be88-4be69dc205fb {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:39 user nova-compute[72815]: INFO nova.compute.manager [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Attaching volume 13d2c7d0-c8e7-4628-bbb0-bb099d12dedf to /dev/vdb
Aug 17 20:21:39 user nova-compute[72815]: DEBUG os_brick.utils [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ffa84d-e880-49d7-a3cc-6db2357f000e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c012afcb-eaa0-4235-bf02-ed2775f8905e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4264486d-ce4b-4280-866d-301db4f5bca5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae0f293-f1d1-4398-9fc0-9abb18b8c01d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:21:39 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:21:39 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54dd91a-45e9-4f8c-962e-b1b077337765]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG os_brick.utils [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:21:39 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updating existing volume attachment record: 5d182db5-ae04-410c-8375-304055beef95 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:21:41 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:21:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:41 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:41 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:21:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:42 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:43 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:21:43 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:21:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=8276MB free_disk=25.267635345458984GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 20a2c899-49ce-4118-be88-4be69dc205fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance d73a930e-2c4c-42d4-a126-dd6a04d4dbe6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 35d7e1a6-06e2-48e8-babb-af7b31d50d77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:21:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:44 user nova-compute[72815]: INFO nova.compute.manager [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Terminating instance
Aug 17 20:21:44 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-e214f825-81ea-4506-b0f1-e11dec1bb05c req-1152952a-e039-47b5-a2c9-03ca188f90b2 service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Received event network-vif-unplugged-5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e214f825-81ea-4506-b0f1-e11dec1bb05c req-1152952a-e039-47b5-a2c9-03ca188f90b2 service nova] Acquiring lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e214f825-81ea-4506-b0f1-e11dec1bb05c req-1152952a-e039-47b5-a2c9-03ca188f90b2 service nova] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-e214f825-81ea-4506-b0f1-e11dec1bb05c req-1152952a-e039-47b5-a2c9-03ca188f90b2 service nova] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-e214f825-81ea-4506-b0f1-e11dec1bb05c req-1152952a-e039-47b5-a2c9-03ca188f90b2 service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] No waiting events found dispatching network-vif-unplugged-5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:21:44 user nova-compute[72815]: DEBUG nova.compute.manager [req-e214f825-81ea-4506-b0f1-e11dec1bb05c req-1152952a-e039-47b5-a2c9-03ca188f90b2 service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Received event network-vif-unplugged-5127c14c-89b2-4b72-baae-0d530cb06de6 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:21:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:45 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Instance destroyed successfully.
Aug 17 20:21:45 user nova-compute[72815]: DEBUG nova.objects.instance [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lazy-loading 'resources' on Instance uuid d73a930e-2c4c-42d4-a126-dd6a04d4dbe6 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:21:45 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-942346103',display_name='tempest-VolumesActionsTest-instance-942346103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-942346103',id=49,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:20:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c884a816adc40bf9932e18058380156',ramdisk_id='',reservation_id='r-n7dliubw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-396564338',owner_user_name='tempest-VolumesActionsTest-396564338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:20:02Z,user_data=None,user_id='5d0912af2d65439f9f816c6aa00e9a56',uuid=d73a930e-2c4c-42d4-a126-dd6a04d4dbe6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5127c14c-89b2-4b72-baae-0d530cb06de6", "address": "fa:16:3e:95:4b:01", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5127c14c-89", "ovs_interfaceid": "5127c14c-89b2-4b72-baae-0d530cb06de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:21:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Converting VIF {"id": "5127c14c-89b2-4b72-baae-0d530cb06de6", "address": "fa:16:3e:95:4b:01", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5127c14c-89", "ovs_interfaceid": "5127c14c-89b2-4b72-baae-0d530cb06de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:21:45 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=5127c14c-89b2-4b72-baae-0d530cb06de6,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5127c14c-89') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:21:45 user nova-compute[72815]: DEBUG os_vif [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=5127c14c-89b2-4b72-baae-0d530cb06de6,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5127c14c-89') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:21:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5127c14c-89, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:21:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:45 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:21:45 user nova-compute[72815]: INFO os_vif [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=5127c14c-89b2-4b72-baae-0d530cb06de6,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5127c14c-89')
Aug 17 20:21:45 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Deleting instance files /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6_del
Aug 17 20:21:45 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Deletion of /opt/stack/data/nova/instances/d73a930e-2c4c-42d4-a126-dd6a04d4dbe6_del complete
Aug 17 20:21:45 user nova-compute[72815]: INFO nova.compute.manager [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 20:21:45 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:21:45 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:21:45 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:21:46 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:21:46 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Took 0.50 seconds to deallocate network for instance.
Aug 17 20:21:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:46 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:21:46 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:21:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:46 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Deleted allocations for instance d73a930e-2c4c-42d4-a126-dd6a04d4dbe6
Aug 17 20:21:46 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-bb021e35-7b6d-4966-a743-879bd401c37d tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.738s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-8c7a5d19-d78c-49c4-b361-dd39da9ca8f8 req-e54d0494-2167-4bc1-b363-fa675001612d service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Received event network-vif-plugged-5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8c7a5d19-d78c-49c4-b361-dd39da9ca8f8 req-e54d0494-2167-4bc1-b363-fa675001612d service nova] Acquiring lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8c7a5d19-d78c-49c4-b361-dd39da9ca8f8 req-e54d0494-2167-4bc1-b363-fa675001612d service nova] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8c7a5d19-d78c-49c4-b361-dd39da9ca8f8 req-e54d0494-2167-4bc1-b363-fa675001612d service nova] Lock "d73a930e-2c4c-42d4-a126-dd6a04d4dbe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-8c7a5d19-d78c-49c4-b361-dd39da9ca8f8 req-e54d0494-2167-4bc1-b363-fa675001612d service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] No waiting events found dispatching network-vif-plugged-5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:21:47 user nova-compute[72815]: WARNING nova.compute.manager [req-8c7a5d19-d78c-49c4-b361-dd39da9ca8f8 req-e54d0494-2167-4bc1-b363-fa675001612d service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Received unexpected event network-vif-plugged-5127c14c-89b2-4b72-baae-0d530cb06de6 for instance with vm_state deleted and task_state None.
Aug 17 20:21:47 user nova-compute[72815]: DEBUG nova.compute.manager [req-8c7a5d19-d78c-49c4-b361-dd39da9ca8f8 req-e54d0494-2167-4bc1-b363-fa675001612d service nova] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Received event network-vif-deleted-5127c14c-89b2-4b72-baae-0d530cb06de6 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:21:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:21:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:21:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:21:48 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:21:49 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updating instance_info_cache with network_info: [{"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:21:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:21:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:21:49 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:21:49 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:21:49 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VkIaswRY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:21:50 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:21:50 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:21:50 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[305fec96-e733-4ee4-8888-4ebbfaac3022]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:21:50 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbefd5bb-55f1-4694-a57e-b2ac6921f3b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf] added
Aug 17 20:21:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a525772f-1e38-470b-98e6-216908b9bab8]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf36ddf-73f0-46de-a433-5cd854c6b052]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VkIaswRY {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VkIaswRY" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f2e33b-cf6a-4acf-bcf2-46d64d3533f7]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VkIaswRY'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedd247b-d1af-4c8f-b56a-8b0ceb337a28]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40f0e7b-ed1e-4126-8f09-69404d571d2e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 20:21:50 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 20:21:50 user nova-compute[72815]:  {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:21:50 user nova-compute[72815]: WARNING os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 20:21:50 user nova-compute[72815]: 
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba776f53-de5f-4030-99a7-14801aa4015b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf, portal: 172.16.0.220,3260]
Aug 17 20:21:50 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf, portal: 172.16.0.220,3260] successful.
Aug 17 20:21:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9832ba9c-07a2-4d32-b7e0-e29e3e0c7031]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42caee7-ffb7-4988-af58-cfa5df006d5f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)
Aug 17 20:21:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)
Aug 17 20:21:50 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee046d72-bbca-44c8-8876-88dbb7c8bb0d]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:21:50 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VkIaswRY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:21:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:21:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26236333232626139', 'path': '/dev/sdb'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:21:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236333232626139', 'path': '/dev/sdb'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:21:51 user nova-compute[72815]: DEBUG nova.objects.instance [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'flavor' on Instance uuid 20a2c899-49ce-4118-be88-4be69dc205fb {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:21:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:21:51 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:21:51 user nova-compute[72815]:   <source dev="/dev/sdb"/>
Aug 17 20:21:51 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:21:51 user nova-compute[72815]:   <serial>13d2c7d0-c8e7-4628-bbb0-bb099d12dedf</serial>
Aug 17 20:21:51 user nova-compute[72815]: </disk>
Aug 17 20:21:51 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:21:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:21:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:21:52 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] No VIF found with MAC fa:16:3e:92:d7:ac, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:21:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-41b35b8a-7432-4574-a33f-8d4f86c04efc tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.658s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:21:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:21:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:21:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:21:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-c86849db-5214-4054-b210-458859961b92 req-16004d38-e2c7-40bd-b0da-1f2402a13191 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-changed-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-c86849db-5214-4054-b210-458859961b92 req-16004d38-e2c7-40bd-b0da-1f2402a13191 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Refreshing instance network info cache due to event network-changed-6e92fa72-b9bc-4631-8620-2acce92bacab. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c86849db-5214-4054-b210-458859961b92 req-16004d38-e2c7-40bd-b0da-1f2402a13191 service nova] Acquiring lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c86849db-5214-4054-b210-458859961b92 req-16004d38-e2c7-40bd-b0da-1f2402a13191 service nova] Acquired lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG nova.network.neutron [req-c86849db-5214-4054-b210-458859961b92 req-16004d38-e2c7-40bd-b0da-1f2402a13191 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Refreshing network info cache for port 6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG nova.network.neutron [req-c86849db-5214-4054-b210-458859961b92 req-16004d38-e2c7-40bd-b0da-1f2402a13191 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updated VIF entry in instance network info cache for port 6e92fa72-b9bc-4631-8620-2acce92bacab. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG nova.network.neutron [req-c86849db-5214-4054-b210-458859961b92 req-16004d38-e2c7-40bd-b0da-1f2402a13191 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updating instance_info_cache with network_info: [{"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-c86849db-5214-4054-b210-458859961b92 req-16004d38-e2c7-40bd-b0da-1f2402a13191 service nova] Releasing lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:21:55 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:21:57 user nova-compute[72815]: INFO nova.compute.manager [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Rebooting instance
Aug 17 20:21:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-52413e94-8ea3-4a2f-bd9d-94fe31bcfe25 req-83936dac-4a69-4716-936b-a9c6dc8845f5 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-changed-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG nova.compute.manager [req-52413e94-8ea3-4a2f-bd9d-94fe31bcfe25 req-83936dac-4a69-4716-936b-a9c6dc8845f5 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Refreshing instance network info cache due to event network-changed-6e92fa72-b9bc-4631-8620-2acce92bacab. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-52413e94-8ea3-4a2f-bd9d-94fe31bcfe25 req-83936dac-4a69-4716-936b-a9c6dc8845f5 service nova] Acquiring lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-52413e94-8ea3-4a2f-bd9d-94fe31bcfe25 req-83936dac-4a69-4716-936b-a9c6dc8845f5 service nova] Acquired lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-52413e94-8ea3-4a2f-bd9d-94fe31bcfe25 req-83936dac-4a69-4716-936b-a9c6dc8845f5 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Refreshing network info cache for port 6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-52413e94-8ea3-4a2f-bd9d-94fe31bcfe25 req-83936dac-4a69-4716-936b-a9c6dc8845f5 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updated VIF entry in instance network info cache for port 6e92fa72-b9bc-4631-8620-2acce92bacab. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG nova.network.neutron [req-52413e94-8ea3-4a2f-bd9d-94fe31bcfe25 req-83936dac-4a69-4716-936b-a9c6dc8845f5 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updating instance_info_cache with network_info: [{"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-52413e94-8ea3-4a2f-bd9d-94fe31bcfe25 req-83936dac-4a69-4716-936b-a9c6dc8845f5 service nova] Releasing lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquired lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:21:57 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:21:58 user nova-compute[72815]: DEBUG nova.network.neutron [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updating instance_info_cache with network_info: [{"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:21:58 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Releasing lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:21:58 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:22:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:00 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303705.476599, d73a930e-2c4c-42d4-a126-dd6a04d4dbe6 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:22:00 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] VM Stopped (Lifecycle Event)
Aug 17 20:22:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ddf02fe6-a1a9-492e-90bb-7f8321036899 None None] [instance: d73a930e-2c4c-42d4-a126-dd6a04d4dbe6] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:22:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:00 user nova-compute[72815]: DEBUG nova.compute.manager [req-da1e83e0-0f79-4631-a5d4-071931a601b2 req-de782c36-1e5e-4462-8626-8e764d1aedb9 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-vif-unplugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:22:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-da1e83e0-0f79-4631-a5d4-071931a601b2 req-de782c36-1e5e-4462-8626-8e764d1aedb9 service nova] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-da1e83e0-0f79-4631-a5d4-071931a601b2 req-de782c36-1e5e-4462-8626-8e764d1aedb9 service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-da1e83e0-0f79-4631-a5d4-071931a601b2 req-de782c36-1e5e-4462-8626-8e764d1aedb9 service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:00 user nova-compute[72815]: DEBUG nova.compute.manager [req-da1e83e0-0f79-4631-a5d4-071931a601b2 req-de782c36-1e5e-4462-8626-8e764d1aedb9 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] No waiting events found dispatching network-vif-unplugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:22:00 user nova-compute[72815]: WARNING nova.compute.manager [req-da1e83e0-0f79-4631-a5d4-071931a601b2 req-de782c36-1e5e-4462-8626-8e764d1aedb9 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received unexpected event network-vif-unplugged-6e92fa72-b9bc-4631-8620-2acce92bacab for instance with vm_state active and task_state reboot_started.
Aug 17 20:22:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:01 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Instance shutdown successfully.
Aug 17 20:22:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-7c53bd42-1a8b-4b79-88c4-6f26cd6295de req-d33022ee-9a21-437b-8050-e9d634132c1e service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:22:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7c53bd42-1a8b-4b79-88c4-6f26cd6295de req-d33022ee-9a21-437b-8050-e9d634132c1e service nova] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7c53bd42-1a8b-4b79-88c4-6f26cd6295de req-d33022ee-9a21-437b-8050-e9d634132c1e service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:02 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-7c53bd42-1a8b-4b79-88c4-6f26cd6295de req-d33022ee-9a21-437b-8050-e9d634132c1e service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:02 user nova-compute[72815]: DEBUG nova.compute.manager [req-7c53bd42-1a8b-4b79-88c4-6f26cd6295de req-d33022ee-9a21-437b-8050-e9d634132c1e service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] No waiting events found dispatching network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:22:02 user nova-compute[72815]: WARNING nova.compute.manager [req-7c53bd42-1a8b-4b79-88c4-6f26cd6295de req-d33022ee-9a21-437b-8050-e9d634132c1e service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received unexpected event network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab for instance with vm_state active and task_state reboot_started.
Aug 17 20:22:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-31840e1d-b036-4428-ac7a-f51dffd7c9ef req-1a23b2ea-b7d3-43f8-9b2e-6ee8f73539ee service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-31840e1d-b036-4428-ac7a-f51dffd7c9ef req-1a23b2ea-b7d3-43f8-9b2e-6ee8f73539ee service nova] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-31840e1d-b036-4428-ac7a-f51dffd7c9ef req-1a23b2ea-b7d3-43f8-9b2e-6ee8f73539ee service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-31840e1d-b036-4428-ac7a-f51dffd7c9ef req-1a23b2ea-b7d3-43f8-9b2e-6ee8f73539ee service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-31840e1d-b036-4428-ac7a-f51dffd7c9ef req-1a23b2ea-b7d3-43f8-9b2e-6ee8f73539ee service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] No waiting events found dispatching network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:22:04 user nova-compute[72815]: WARNING nova.compute.manager [req-31840e1d-b036-4428-ac7a-f51dffd7c9ef req-1a23b2ea-b7d3-43f8-9b2e-6ee8f73539ee service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received unexpected event network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab for instance with vm_state active and task_state reboot_started.
Aug 17 20:22:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-31840e1d-b036-4428-ac7a-f51dffd7c9ef req-1a23b2ea-b7d3-43f8-9b2e-6ee8f73539ee service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-31840e1d-b036-4428-ac7a-f51dffd7c9ef req-1a23b2ea-b7d3-43f8-9b2e-6ee8f73539ee service nova] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-31840e1d-b036-4428-ac7a-f51dffd7c9ef req-1a23b2ea-b7d3-43f8-9b2e-6ee8f73539ee service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-31840e1d-b036-4428-ac7a-f51dffd7c9ef req-1a23b2ea-b7d3-43f8-9b2e-6ee8f73539ee service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG nova.compute.manager [req-31840e1d-b036-4428-ac7a-f51dffd7c9ef req-1a23b2ea-b7d3-43f8-9b2e-6ee8f73539ee service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] No waiting events found dispatching network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:22:04 user nova-compute[72815]: WARNING nova.compute.manager [req-31840e1d-b036-4428-ac7a-f51dffd7c9ef req-1a23b2ea-b7d3-43f8-9b2e-6ee8f73539ee service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received unexpected event network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab for instance with vm_state active and task_state reboot_started.
Aug 17 20:22:04 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Removed pending event for 20a2c899-49ce-4118-be88-4be69dc205fb due to event {{(pid=72815) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303724.8780055, 20a2c899-49ce-4118-be88-4be69dc205fb => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:22:04 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] VM Resumed (Lifecycle Event)
Aug 17 20:22:04 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Instance running successfully.
Aug 17 20:22:04 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Instance soft rebooted successfully.
Aug 17 20:22:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:22:04 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 17 20:22:04 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303724.8799362, 20a2c899-49ce-4118-be88-4be69dc205fb => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:22:04 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] VM Started (Lifecycle Event)
Aug 17 20:22:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:22:04 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-d346628d-7c05-4353-b431-8e8816eff2d4 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.837s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:05 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:06 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:10 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:20 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:22 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:25 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:30 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:32 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:35 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "9b074879-428b-4442-b322-f4fdfce4708f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "9b074879-428b-4442-b322-f4fdfce4708f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:36 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Starting instance... {{(pid=72815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 20:22:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:36 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:36 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 20:22:36 user nova-compute[72815]: INFO nova.compute.claims [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Claim successful on node user
Aug 17 20:22:37 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Start building networks asynchronously for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Allocating IP information in the background. {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] allocate_for_instance() {{(pid=72815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 20:22:37 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 20:22:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Start building block device mappings for instance. {{(pid=72815) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG nova.policy [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d0912af2d65439f9f816c6aa00e9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c884a816adc40bf9932e18058380156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72815) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Start spawning the instance on the hypervisor. {{(pid=72815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Creating instance directory {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 20:22:37 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Creating image(s)
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "/opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "/opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.187s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.185s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk 1073741824 {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28,backing_fmt=raw /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk 1073741824" returned: 0 in 0.057s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "4e458e1db3c643f9955cf1d7cbf0c90131c96a28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:22:37 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Successfully created port: 4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 --force-share --output=json" returned: 0 in 0.217s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk. size=1073741824 {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG nova.virt.disk.api [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Cannot resize image /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk to a smaller size. {{(pid=72815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lazy-loading 'migration_context' on Instance uuid 9b074879-428b-4442-b322-f4fdfce4708f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Created local disks {{(pid=72815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Ensure instance console log exists: /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/console.log {{(pid=72815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Successfully updated port: 4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "refresh_cache-9b074879-428b-4442-b322-f4fdfce4708f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquired lock "refresh_cache-9b074879-428b-4442-b322-f4fdfce4708f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Building network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-64fff6b4-62bd-45bb-946a-3df0d3aa47ee req-bac74810-bed5-4e17-9bad-1e826a330df3 service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Received event network-changed-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG nova.compute.manager [req-64fff6b4-62bd-45bb-946a-3df0d3aa47ee req-bac74810-bed5-4e17-9bad-1e826a330df3 service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Refreshing instance network info cache due to event network-changed-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-64fff6b4-62bd-45bb-946a-3df0d3aa47ee req-bac74810-bed5-4e17-9bad-1e826a330df3 service nova] Acquiring lock "refresh_cache-9b074879-428b-4442-b322-f4fdfce4708f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:22:38 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Instance cache missing network info. {{(pid=72815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.network.neutron [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Updating instance_info_cache with network_info: [{"id": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "address": "fa:16:3e:9a:d2:8e", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba77d7e-33", "ovs_interfaceid": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Releasing lock "refresh_cache-9b074879-428b-4442-b322-f4fdfce4708f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Instance network_info: |[{"id": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "address": "fa:16:3e:9a:d2:8e", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba77d7e-33", "ovs_interfaceid": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-64fff6b4-62bd-45bb-946a-3df0d3aa47ee req-bac74810-bed5-4e17-9bad-1e826a330df3 service nova] Acquired lock "refresh_cache-9b074879-428b-4442-b322-f4fdfce4708f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.network.neutron [req-64fff6b4-62bd-45bb-946a-3df0d3aa47ee req-bac74810-bed5-4e17-9bad-1e826a330df3 service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Refreshing network info cache for port 4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Start _get_guest_xml network_info=[{"id": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "address": "fa:16:3e:9a:d2:8e", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba77d7e-33", "ovs_interfaceid": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'size': 0, 'image_id': '03ea87a0-d39d-476c-ae9f-307cb35323b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 20:22:39 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:22:39 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CPU controller missing on host. {{(pid=72815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.host [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CPU controller found on host. {{(pid=72815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T19:49:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T19:49:45Z,direct_url=<?>,disk_format='qcow2',id=03ea87a0-d39d-476c-ae9f-307cb35323b8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a9954624a59348f3ab4e9691dd6f1b34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T19:49:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Flavor limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Image limits 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Flavor pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Image pref 0:0:0 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Got 1 possible topologies {{(pid=72815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.hardware [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:22:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-219282586',display_name='tempest-VolumesActionsTest-instance-219282586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-219282586',id=52,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c884a816adc40bf9932e18058380156',ramdisk_id='',reservation_id='r-v6rc3ex8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-396564338',owner_user_name='tempest-VolumesActionsTest-396564338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:22:37Z,user_data=None,user_id='5d0912af2d65439f9f816c6aa00e9a56',uuid=9b074879-428b-4442-b322-f4fdfce4708f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "address": "fa:16:3e:9a:d2:8e", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba77d7e-33", "ovs_interfaceid": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Converting VIF {"id": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "address": "fa:16:3e:9a:d2:8e", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba77d7e-33", "ovs_interfaceid": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d2:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba77d7e-33') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.objects.instance [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b074879-428b-4442-b322-f4fdfce4708f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 20:22:39 user nova-compute[72815]:   <uuid>9b074879-428b-4442-b322-f4fdfce4708f</uuid>
Aug 17 20:22:39 user nova-compute[72815]:   <name>instance-00000034</name>
Aug 17 20:22:39 user nova-compute[72815]:   <memory>524288</memory>
Aug 17 20:22:39 user nova-compute[72815]:   <vcpu>1</vcpu>
Aug 17 20:22:39 user nova-compute[72815]:   <metadata>
Aug 17 20:22:39 user nova-compute[72815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 20:22:39 user nova-compute[72815]:       <nova:package version="0.0.0"/>
Aug 17 20:22:39 user nova-compute[72815]:       <nova:name>tempest-VolumesActionsTest-instance-219282586</nova:name>
Aug 17 20:22:39 user nova-compute[72815]:       <nova:creationTime>2023-08-17 20:22:39</nova:creationTime>
Aug 17 20:22:39 user nova-compute[72815]:       <nova:flavor name="m1.tiny">
Aug 17 20:22:39 user nova-compute[72815]:         <nova:memory>512</nova:memory>
Aug 17 20:22:39 user nova-compute[72815]:         <nova:disk>1</nova:disk>
Aug 17 20:22:39 user nova-compute[72815]:         <nova:swap>0</nova:swap>
Aug 17 20:22:39 user nova-compute[72815]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 20:22:39 user nova-compute[72815]:         <nova:vcpus>1</nova:vcpus>
Aug 17 20:22:39 user nova-compute[72815]:       </nova:flavor>
Aug 17 20:22:39 user nova-compute[72815]:       <nova:owner>
Aug 17 20:22:39 user nova-compute[72815]:         <nova:user uuid="5d0912af2d65439f9f816c6aa00e9a56">tempest-VolumesActionsTest-396564338-project-member</nova:user>
Aug 17 20:22:39 user nova-compute[72815]:         <nova:project uuid="7c884a816adc40bf9932e18058380156">tempest-VolumesActionsTest-396564338</nova:project>
Aug 17 20:22:39 user nova-compute[72815]:       </nova:owner>
Aug 17 20:22:39 user nova-compute[72815]:       <nova:root type="image" uuid="03ea87a0-d39d-476c-ae9f-307cb35323b8"/>
Aug 17 20:22:39 user nova-compute[72815]:       <nova:ports>
Aug 17 20:22:39 user nova-compute[72815]:         <nova:port uuid="4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9">
Aug 17 20:22:39 user nova-compute[72815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 20:22:39 user nova-compute[72815]:         </nova:port>
Aug 17 20:22:39 user nova-compute[72815]:       </nova:ports>
Aug 17 20:22:39 user nova-compute[72815]:     </nova:instance>
Aug 17 20:22:39 user nova-compute[72815]:   </metadata>
Aug 17 20:22:39 user nova-compute[72815]:   <sysinfo type="smbios">
Aug 17 20:22:39 user nova-compute[72815]:     <system>
Aug 17 20:22:39 user nova-compute[72815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 20:22:39 user nova-compute[72815]:       <entry name="product">OpenStack Nova</entry>
Aug 17 20:22:39 user nova-compute[72815]:       <entry name="version">0.0.0</entry>
Aug 17 20:22:39 user nova-compute[72815]:       <entry name="serial">9b074879-428b-4442-b322-f4fdfce4708f</entry>
Aug 17 20:22:39 user nova-compute[72815]:       <entry name="uuid">9b074879-428b-4442-b322-f4fdfce4708f</entry>
Aug 17 20:22:39 user nova-compute[72815]:       <entry name="family">Virtual Machine</entry>
Aug 17 20:22:39 user nova-compute[72815]:     </system>
Aug 17 20:22:39 user nova-compute[72815]:   </sysinfo>
Aug 17 20:22:39 user nova-compute[72815]:   <os>
Aug 17 20:22:39 user nova-compute[72815]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 20:22:39 user nova-compute[72815]:     <boot dev="hd"/>
Aug 17 20:22:39 user nova-compute[72815]:     <smbios mode="sysinfo"/>
Aug 17 20:22:39 user nova-compute[72815]:   </os>
Aug 17 20:22:39 user nova-compute[72815]:   <features>
Aug 17 20:22:39 user nova-compute[72815]:     <acpi/>
Aug 17 20:22:39 user nova-compute[72815]:     <apic/>
Aug 17 20:22:39 user nova-compute[72815]:     <vmcoreinfo/>
Aug 17 20:22:39 user nova-compute[72815]:   </features>
Aug 17 20:22:39 user nova-compute[72815]:   <clock offset="utc">
Aug 17 20:22:39 user nova-compute[72815]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 20:22:39 user nova-compute[72815]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 20:22:39 user nova-compute[72815]:     <timer name="hpet" present="no"/>
Aug 17 20:22:39 user nova-compute[72815]:   </clock>
Aug 17 20:22:39 user nova-compute[72815]:   <cpu mode="custom" match="exact">
Aug 17 20:22:39 user nova-compute[72815]:     <model>Nehalem</model>
Aug 17 20:22:39 user nova-compute[72815]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 20:22:39 user nova-compute[72815]:   </cpu>
Aug 17 20:22:39 user nova-compute[72815]:   <devices>
Aug 17 20:22:39 user nova-compute[72815]:     <disk type="file" device="disk">
Aug 17 20:22:39 user nova-compute[72815]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 20:22:39 user nova-compute[72815]:       <source file="/opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk"/>
Aug 17 20:22:39 user nova-compute[72815]:       <target dev="vda" bus="virtio"/>
Aug 17 20:22:39 user nova-compute[72815]:     </disk>
Aug 17 20:22:39 user nova-compute[72815]:     <interface type="ethernet">
Aug 17 20:22:39 user nova-compute[72815]:       <mac address="fa:16:3e:9a:d2:8e"/>
Aug 17 20:22:39 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:22:39 user nova-compute[72815]:       <mtu size="1442"/>
Aug 17 20:22:39 user nova-compute[72815]:       <target dev="tap4ba77d7e-33"/>
Aug 17 20:22:39 user nova-compute[72815]:     </interface>
Aug 17 20:22:39 user nova-compute[72815]:     <serial type="pty">
Aug 17 20:22:39 user nova-compute[72815]:       <log file="/opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/console.log" append="off"/>
Aug 17 20:22:39 user nova-compute[72815]:     </serial>
Aug 17 20:22:39 user nova-compute[72815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 20:22:39 user nova-compute[72815]:     <video>
Aug 17 20:22:39 user nova-compute[72815]:       <model type="virtio"/>
Aug 17 20:22:39 user nova-compute[72815]:     </video>
Aug 17 20:22:39 user nova-compute[72815]:     <rng model="virtio">
Aug 17 20:22:39 user nova-compute[72815]:       <backend model="random">/dev/urandom</backend>
Aug 17 20:22:39 user nova-compute[72815]:     </rng>
Aug 17 20:22:39 user nova-compute[72815]:     <controller type="usb" index="0" model="none"/>
Aug 17 20:22:39 user nova-compute[72815]:     <memballoon model="virtio">
Aug 17 20:22:39 user nova-compute[72815]:       <stats period="10"/>
Aug 17 20:22:39 user nova-compute[72815]:     </memballoon>
Aug 17 20:22:39 user nova-compute[72815]:   </devices>
Aug 17 20:22:39 user nova-compute[72815]: </domain>
Aug 17 20:22:39 user nova-compute[72815]:  {{(pid=72815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:22:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-219282586',display_name='tempest-VolumesActionsTest-instance-219282586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-219282586',id=52,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c884a816adc40bf9932e18058380156',ramdisk_id='',reservation_id='r-v6rc3ex8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-396564338',owner_user_name='tempest-VolumesActionsTest-396564338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T20:22:37Z,user_data=None,user_id='5d0912af2d65439f9f816c6aa00e9a56',uuid=9b074879-428b-4442-b322-f4fdfce4708f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "address": "fa:16:3e:9a:d2:8e", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba77d7e-33", "ovs_interfaceid": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Converting VIF {"id": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "address": "fa:16:3e:9a:d2:8e", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba77d7e-33", "ovs_interfaceid": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d2:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba77d7e-33') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG os_vif [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d2:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba77d7e-33') {{(pid=72815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ba77d7e-33, may_exist=True, interface_attrs={}) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ba77d7e-33, col_values=(('external_ids', {'iface-id': '4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:d2:8e', 'vm-uuid': '9b074879-428b-4442-b322-f4fdfce4708f'}),), if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:39 user nova-compute[72815]: INFO os_vif [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d2:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba77d7e-33')
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] No VIF found with MAC fa:16:3e:9a:d2:8e, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.network.neutron [req-64fff6b4-62bd-45bb-946a-3df0d3aa47ee req-bac74810-bed5-4e17-9bad-1e826a330df3 service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Updated VIF entry in instance network info cache for port 4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG nova.network.neutron [req-64fff6b4-62bd-45bb-946a-3df0d3aa47ee req-bac74810-bed5-4e17-9bad-1e826a330df3 service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Updating instance_info_cache with network_info: [{"id": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "address": "fa:16:3e:9a:d2:8e", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba77d7e-33", "ovs_interfaceid": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:22:39 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-64fff6b4-62bd-45bb-946a-3df0d3aa47ee req-bac74810-bed5-4e17-9bad-1e826a330df3 service nova] Releasing lock "refresh_cache-9b074879-428b-4442-b322-f4fdfce4708f" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:22:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:40 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-9e91c2eb-08a2-4a88-b0a1-59b6d1795bab req-6fbc404e-234c-4a72-a6ab-116032109e78 service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Received event network-vif-plugged-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:22:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9e91c2eb-08a2-4a88-b0a1-59b6d1795bab req-6fbc404e-234c-4a72-a6ab-116032109e78 service nova] Acquiring lock "9b074879-428b-4442-b322-f4fdfce4708f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9e91c2eb-08a2-4a88-b0a1-59b6d1795bab req-6fbc404e-234c-4a72-a6ab-116032109e78 service nova] Lock "9b074879-428b-4442-b322-f4fdfce4708f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:40 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-9e91c2eb-08a2-4a88-b0a1-59b6d1795bab req-6fbc404e-234c-4a72-a6ab-116032109e78 service nova] Lock "9b074879-428b-4442-b322-f4fdfce4708f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:40 user nova-compute[72815]: DEBUG nova.compute.manager [req-9e91c2eb-08a2-4a88-b0a1-59b6d1795bab req-6fbc404e-234c-4a72-a6ab-116032109e78 service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] No waiting events found dispatching network-vif-plugged-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:22:40 user nova-compute[72815]: WARNING nova.compute.manager [req-9e91c2eb-08a2-4a88-b0a1-59b6d1795bab req-6fbc404e-234c-4a72-a6ab-116032109e78 service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Received unexpected event network-vif-plugged-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 for instance with vm_state building and task_state spawning.
Aug 17 20:22:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303762.5122519, 9b074879-428b-4442-b322-f4fdfce4708f => Resumed> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:22:42 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] VM Resumed (Lifecycle Event)
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Instance event wait completed in 0 seconds for  {{(pid=72815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Guest created on hypervisor {{(pid=72815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 20:22:42 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Instance spawned successfully.
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Found default for hw_cdrom_bus of ide {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Found default for hw_disk_bus of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Found default for hw_input_bus of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Found default for hw_pointer_model of None {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Found default for hw_video_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Found default for hw_vif_model of virtio {{(pid=72815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 20:22:42 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.virt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Emitting event <LifecycleEvent: 1692303762.5156128, 9b074879-428b-4442-b322-f4fdfce4708f => Started> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:22:42 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] VM Started (Lifecycle Event)
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72815) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 20:22:42 user nova-compute[72815]: INFO nova.compute.manager [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 20:22:42 user nova-compute[72815]: INFO nova.compute.manager [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Took 5.29 seconds to spawn the instance on the hypervisor.
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.compute.manager [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:22:42 user nova-compute[72815]: INFO nova.compute.manager [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Took 5.81 seconds to build instance.
Aug 17 20:22:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-0e40716c-4fb1-4501-aeb0-8863b7b051b3 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "9b074879-428b-4442-b322-f4fdfce4708f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.942s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.compute.manager [req-6cd4c535-cca5-459f-8236-21b9889ec981 req-3b5ea54e-356e-4f28-ae77-c801cdb5ceab service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Received event network-vif-plugged-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6cd4c535-cca5-459f-8236-21b9889ec981 req-3b5ea54e-356e-4f28-ae77-c801cdb5ceab service nova] Acquiring lock "9b074879-428b-4442-b322-f4fdfce4708f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6cd4c535-cca5-459f-8236-21b9889ec981 req-3b5ea54e-356e-4f28-ae77-c801cdb5ceab service nova] Lock "9b074879-428b-4442-b322-f4fdfce4708f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-6cd4c535-cca5-459f-8236-21b9889ec981 req-3b5ea54e-356e-4f28-ae77-c801cdb5ceab service nova] Lock "9b074879-428b-4442-b322-f4fdfce4708f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.compute.manager [req-6cd4c535-cca5-459f-8236-21b9889ec981 req-3b5ea54e-356e-4f28-ae77-c801cdb5ceab service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] No waiting events found dispatching network-vif-plugged-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:22:42 user nova-compute[72815]: WARNING nova.compute.manager [req-6cd4c535-cca5-459f-8236-21b9889ec981 req-3b5ea54e-356e-4f28-ae77-c801cdb5ceab service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Received unexpected event network-vif-plugged-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 for instance with vm_state active and task_state None.
Aug 17 20:22:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:42 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:22:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:22:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:22:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:22:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:22:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:22:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:22:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:22:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:22:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:22:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:22:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:22:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:22:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:22:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=8482MB free_disk=25.283042907714844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 20a2c899-49ce-4118-be88-4be69dc205fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 35d7e1a6-06e2-48e8-babb-af7b31d50d77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 9b074879-428b-4442-b322-f4fdfce4708f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:22:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:22:47 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:49 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:22:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:22:49 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 20:22:49 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:22:49 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:22:50 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:22:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:22:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:22:53 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:22:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:22:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:22:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:22:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:22:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:54 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:22:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-ca611015-89fd-489e-8c28-643824497c83 req-fc6ec559-5918-4a2f-9b9b-4a29492cecf4 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Received event network-changed-b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:22:55 user nova-compute[72815]: DEBUG nova.compute.manager [req-ca611015-89fd-489e-8c28-643824497c83 req-fc6ec559-5918-4a2f-9b9b-4a29492cecf4 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Refreshing instance network info cache due to event network-changed-b3771f5f-ac74-4ab4-9631-9eab589f24ae. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:22:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ca611015-89fd-489e-8c28-643824497c83 req-fc6ec559-5918-4a2f-9b9b-4a29492cecf4 service nova] Acquiring lock "refresh_cache-35d7e1a6-06e2-48e8-babb-af7b31d50d77" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:22:55 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ca611015-89fd-489e-8c28-643824497c83 req-fc6ec559-5918-4a2f-9b9b-4a29492cecf4 service nova] Acquired lock "refresh_cache-35d7e1a6-06e2-48e8-babb-af7b31d50d77" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:22:55 user nova-compute[72815]: DEBUG nova.network.neutron [req-ca611015-89fd-489e-8c28-643824497c83 req-fc6ec559-5918-4a2f-9b9b-4a29492cecf4 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Refreshing network info cache for port b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:22:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-ca611015-89fd-489e-8c28-643824497c83 req-fc6ec559-5918-4a2f-9b9b-4a29492cecf4 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Updated VIF entry in instance network info cache for port b3771f5f-ac74-4ab4-9631-9eab589f24ae. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:22:56 user nova-compute[72815]: DEBUG nova.network.neutron [req-ca611015-89fd-489e-8c28-643824497c83 req-fc6ec559-5918-4a2f-9b9b-4a29492cecf4 service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Updating instance_info_cache with network_info: [{"id": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "address": "fa:16:3e:b7:d0:cd", "network": {"id": "01c030f2-8e11-48aa-8b7c-bbf377486499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1379663334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a584bbd9ac504db78dd5bf1f5ce8a1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3771f5f-ac", "ovs_interfaceid": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:22:56 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-ca611015-89fd-489e-8c28-643824497c83 req-fc6ec559-5918-4a2f-9b9b-4a29492cecf4 service nova] Releasing lock "refresh_cache-35d7e1a6-06e2-48e8-babb-af7b31d50d77" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:22:57 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:22:57 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:22:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lazy-loading 'flavor' on Instance uuid 35d7e1a6-06e2-48e8-babb-af7b31d50d77 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:23:00 user nova-compute[72815]: INFO nova.compute.manager [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Attaching volume 44a17e54-f7a2-4979-a15a-da2114f7e940 to /dev/vdb
Aug 17 20:23:00 user nova-compute[72815]: DEBUG os_brick.utils [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4573c339-d00b-49a3-9315-b8e7e7e1b1e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6585a8d8892\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[469814c7-5271-4b51-892f-6320c4d1f7dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cdc77d-acd9-4eac-993c-b83d6e9824d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[582f5043-a8f0-4902-9af3-5f964e41a1f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Running cmd (subprocess): nvme version {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] 'nvme version' failed. Not Retrying. {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] nvme not present on system {{(pid=72815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 20:23:00 user nova-compute[72815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 20:23:00 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a63d749-4226-491e-9fba-2ebeb1ecfb5f]: (4, '') {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.lightos [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] LIGHTOS: no hostnqn found. {{(pid=72815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG os_brick.utils [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6585a8d8892', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:23:00 user nova-compute[72815]: DEBUG nova.virt.block_device [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Updating existing volume attachment record: 16b0a84a-6249-4c02-96a9-4c12219718a6 {{(pid=72815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 20:23:02 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:07 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Calling os-brick to attach iSCSI Volume {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fXEljQOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:23:10 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:23:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:23:10 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:23:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:23:10 user nova-compute[72815]: INFO os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fec49f7-2bb7-485a-addb-ee0e6142dabb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 20:23:10 user nova-compute[72815]:  {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --interface default --op new {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bef13b-8e83-47d8-b5bd-7cda294a92df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940] added\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940] added
Aug 17 20:23:10 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6ca6c9-8bc9-4b51-b054-7022eafa0c3b]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[28514982-2bfb-4fbe-b949-2d16a5c27daa]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fXEljQOH {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fXEljQOH" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7849421f-5f9e-4ce8-94ee-30bdc7bcd74d]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fXEljQOH'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c738d24-3b95-4e21-b54f-c50fc3808ee2]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:10 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bacdaa-0c0d-46ce-b9dd-2a2080abd062]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)
Aug 17 20:23:11 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)
Aug 17 20:23:11 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --login {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd31c00-8ee9-43ac-a0e9-2a659506af3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940, portal: 172.16.0.220,3260]
Aug 17 20:23:11 user nova-compute[72815]: Login to [iface: default, target: iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940, portal: 172.16.0.220,3260] successful.
Aug 17 20:23:11 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d62d963-7cfe-40e6-9661-e36f88b34cbd]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cf16b1-ca43-4be4-8054-d580ec5ca04b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)
Aug 17 20:23:11 user nova-compute[72815]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 (non-flash)
Aug 17 20:23:11 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)
Aug 17 20:23:11 user nova-compute[72815]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 (non-flash)
Aug 17 20:23:11 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Connected to 172.16.0.220:3260 {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=72815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f53c8c-affe-4979-87bd-dd879c6458b3]: (4, ('- - 0', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 20:23:11 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fXEljQOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 20:23:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:23:12 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23961323961653239', 'path': '/dev/sdc'} {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:23:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961323961653239', 'path': '/dev/sdc'} {{(pid=72815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 20:23:12 user nova-compute[72815]: DEBUG nova.objects.instance [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lazy-loading 'flavor' on Instance uuid 35d7e1a6-06e2-48e8-babb-af7b31d50d77 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:23:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 20:23:12 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:23:12 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 20:23:12 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:23:12 user nova-compute[72815]:   <serial>44a17e54-f7a2-4979-a15a-da2114f7e940</serial>
Aug 17 20:23:12 user nova-compute[72815]: </disk>
Aug 17 20:23:12 user nova-compute[72815]:  {{(pid=72815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 20:23:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] No BDM found with device name vda, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:23:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 20:23:12 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] No VIF found with MAC fa:16:3e:b7:d0:cd, not building metadata {{(pid=72815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 20:23:12 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-f0e32c8a-9e45-4a51-a851-21506f1f9c6c tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.338s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:23:14 user nova-compute[72815]: INFO nova.compute.manager [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Detaching volume 44a17e54-f7a2-4979-a15a-da2114f7e940
Aug 17 20:23:14 user nova-compute[72815]: INFO nova.virt.block_device [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Attempting to driver detach volume 44a17e54-f7a2-4979-a15a-da2114f7e940 from mountpoint /dev/vdb
Aug 17 20:23:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Attempting to detach device vdb from instance 35d7e1a6-06e2-48e8-babb-af7b31d50d77 from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:23:14 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:23:14 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 20:23:14 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:23:14 user nova-compute[72815]:   <serial>44a17e54-f7a2-4979-a15a-da2114f7e940</serial>
Aug 17 20:23:14 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:23:14 user nova-compute[72815]: </disk>
Aug 17 20:23:14 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:23:14 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Successfully detached device vdb from instance 35d7e1a6-06e2-48e8-babb-af7b31d50d77 from the persistent domain config.
Aug 17 20:23:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35d7e1a6-06e2-48e8-babb-af7b31d50d77 from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:23:14 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:23:14 user nova-compute[72815]:   <source dev="/dev/sdc"/>
Aug 17 20:23:14 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:23:14 user nova-compute[72815]:   <serial>44a17e54-f7a2-4979-a15a-da2114f7e940</serial>
Aug 17 20:23:14 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:23:14 user nova-compute[72815]: </disk>
Aug 17 20:23:14 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692303794.7479074, 35d7e1a6-06e2-48e8-babb-af7b31d50d77 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35d7e1a6-06e2-48e8-babb-af7b31d50d77 {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:23:14 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Successfully detached device vdb from instance 35d7e1a6-06e2-48e8-babb-af7b31d50d77 from the live domain config.
Aug 17 20:23:14 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fXEljQOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:23:14 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02c626c-3eaa-4b77-86d7-3200f8588fdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2ae8a2-b97a-4016-ac88-47ff636960a5]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)
Aug 17 20:23:14 user nova-compute[72815]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 (non-flash)
Aug 17 20:23:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)
Aug 17 20:23:14 user nova-compute[72815]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 (non-flash)
Aug 17 20:23:14 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f39942e6ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940'): ({'sdc'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Removing single pathed devices sdc {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8752fe1-65e1-4d42-97f8-dfc0c7b54af7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[41835b52-3d21-4f67-94dd-cbb0879be4cd]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Flushing IO for device /dev/sdc {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cffdcf-51ef-42f6-828d-6f5a8e47b299]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[286c2179-e8c7-4300-a31a-508f05fd4744]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] SCSI volumes sdc have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5171996-1206-4bb5-8fac-4ca8c632cc27]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:14 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dd3847-7017-4264-894f-db02fa945293]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940, portal: 172.16.0.220,3260]
Aug 17 20:23:15 user nova-compute[72815]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940, portal: 172.16.0.220,3260] successful.
Aug 17 20:23:15 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:15 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a17e54-f7a2-4979-a15a-da2114f7e940 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:15 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c88fe8-eddb-4c70-bff0-fe3f7a025f0a]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:23:15 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] <== disconnect_volume: return (264ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:23:15 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:23:15 user nova-compute[72815]: DEBUG nova.objects.instance [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lazy-loading 'flavor' on Instance uuid 35d7e1a6-06e2-48e8-babb-af7b31d50d77 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:23:15 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-aeec528f-1d04-4234-8cdc-2bf70e52748d tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:23:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:23:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:23:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:23:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:23:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:23:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:23:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:23:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:23:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:29 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:23:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:23:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:23:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:23:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:23:34 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:39 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:23:42 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:23:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:23:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:23:42 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:23:42 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:23:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:43 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 20:23:43 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:23:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:23:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=8445MB free_disk=25.253917694091797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 20a2c899-49ce-4118-be88-4be69dc205fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 35d7e1a6-06e2-48e8-babb-af7b31d50d77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 9b074879-428b-4442-b322-f4fdfce4708f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:23:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:23:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:23:47 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:23:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:23:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:23:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 20:23:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:23:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquired lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:23:49 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Forcefully refreshing network info cache for instance {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 20:23:49 user nova-compute[72815]: DEBUG nova.objects.instance [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lazy-loading 'info_cache' on Instance uuid 20a2c899-49ce-4118-be88-4be69dc205fb {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:23:49 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-b18f7a85-f4c4-41dc-b6e5-be963564fe1a req-a550b698-e519-41a2-9616-17cf971fac5d service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-changed-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-b18f7a85-f4c4-41dc-b6e5-be963564fe1a req-a550b698-e519-41a2-9616-17cf971fac5d service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Refreshing instance network info cache due to event network-changed-6e92fa72-b9bc-4631-8620-2acce92bacab. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b18f7a85-f4c4-41dc-b6e5-be963564fe1a req-a550b698-e519-41a2-9616-17cf971fac5d service nova] Acquiring lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG nova.network.neutron [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updating instance_info_cache with network_info: [{"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Releasing lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updated the network info_cache for instance {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b18f7a85-f4c4-41dc-b6e5-be963564fe1a req-a550b698-e519-41a2-9616-17cf971fac5d service nova] Acquired lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-b18f7a85-f4c4-41dc-b6e5-be963564fe1a req-a550b698-e519-41a2-9616-17cf971fac5d service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Refreshing network info cache for port 6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-b18f7a85-f4c4-41dc-b6e5-be963564fe1a req-a550b698-e519-41a2-9616-17cf971fac5d service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updated VIF entry in instance network info cache for port 6e92fa72-b9bc-4631-8620-2acce92bacab. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-b18f7a85-f4c4-41dc-b6e5-be963564fe1a req-a550b698-e519-41a2-9616-17cf971fac5d service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updating instance_info_cache with network_info: [{"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-b18f7a85-f4c4-41dc-b6e5-be963564fe1a req-a550b698-e519-41a2-9616-17cf971fac5d service nova] Releasing lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-8335def7-cd8f-4a03-9efe-2ec9047147fc req-1da04c0a-4efe-45a0-ae6d-580636d80c37 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-changed-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-8335def7-cd8f-4a03-9efe-2ec9047147fc req-1da04c0a-4efe-45a0-ae6d-580636d80c37 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Refreshing instance network info cache due to event network-changed-6e92fa72-b9bc-4631-8620-2acce92bacab. {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8335def7-cd8f-4a03-9efe-2ec9047147fc req-1da04c0a-4efe-45a0-ae6d-580636d80c37 service nova] Acquiring lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8335def7-cd8f-4a03-9efe-2ec9047147fc req-1da04c0a-4efe-45a0-ae6d-580636d80c37 service nova] Acquired lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 20:23:50 user nova-compute[72815]: DEBUG nova.network.neutron [req-8335def7-cd8f-4a03-9efe-2ec9047147fc req-1da04c0a-4efe-45a0-ae6d-580636d80c37 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Refreshing network info cache for port 6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:23:51 user nova-compute[72815]: INFO nova.compute.manager [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Detaching volume 13d2c7d0-c8e7-4628-bbb0-bb099d12dedf
Aug 17 20:23:51 user nova-compute[72815]: INFO nova.virt.block_device [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Attempting to driver detach volume 13d2c7d0-c8e7-4628-bbb0-bb099d12dedf from mountpoint /dev/vdb
Aug 17 20:23:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Attempting to detach device vdb from instance 20a2c899-49ce-4118-be88-4be69dc205fb from the persistent domain config. {{(pid=72815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:23:51 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:23:51 user nova-compute[72815]:   <source dev="/dev/sdb"/>
Aug 17 20:23:51 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:23:51 user nova-compute[72815]:   <serial>13d2c7d0-c8e7-4628-bbb0-bb099d12dedf</serial>
Aug 17 20:23:51 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:23:51 user nova-compute[72815]: </disk>
Aug 17 20:23:51 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:23:51 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Successfully detached device vdb from instance 20a2c899-49ce-4118-be88-4be69dc205fb from the persistent domain config.
Aug 17 20:23:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20a2c899-49ce-4118-be88-4be69dc205fb from the live domain config. {{(pid=72815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.guest [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 20:23:51 user nova-compute[72815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 20:23:51 user nova-compute[72815]:   <source dev="/dev/sdb"/>
Aug 17 20:23:51 user nova-compute[72815]:   <target dev="vdb" bus="virtio"/>
Aug 17 20:23:51 user nova-compute[72815]:   <serial>13d2c7d0-c8e7-4628-bbb0-bb099d12dedf</serial>
Aug 17 20:23:51 user nova-compute[72815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 20:23:51 user nova-compute[72815]: </disk>
Aug 17 20:23:51 user nova-compute[72815]:  {{(pid=72815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG nova.network.neutron [req-8335def7-cd8f-4a03-9efe-2ec9047147fc req-1da04c0a-4efe-45a0-ae6d-580636d80c37 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updated VIF entry in instance network info cache for port 6e92fa72-b9bc-4631-8620-2acce92bacab. {{(pid=72815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG nova.network.neutron [req-8335def7-cd8f-4a03-9efe-2ec9047147fc req-1da04c0a-4efe-45a0-ae6d-580636d80c37 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updating instance_info_cache with network_info: [{"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-8335def7-cd8f-4a03-9efe-2ec9047147fc req-1da04c0a-4efe-45a0-ae6d-580636d80c37 service nova] Releasing lock "refresh_cache-20a2c899-49ce-4118-be88-4be69dc205fb" {{(pid=72815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-f5ab9cc6-dd80-4a1f-b556-69b7d28d6c7f None None] Received event <DeviceRemovedEvent: 1692303831.6875813, 20a2c899-49ce-4118-be88-4be69dc205fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72815) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.driver [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20a2c899-49ce-4118-be88-4be69dc205fb {{(pid=72815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 20:23:51 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Successfully detached device vdb from instance 20a2c899-49ce-4118-be88-4be69dc205fb from the live domain config.
Aug 17 20:23:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] calling os-brick to detach iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f39b40c4910>, {'target_iqns': ['iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VkIaswRY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 20:23:51 user nova-compute[72815]: WARNING os_brick.initiator.connectors.base [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf', 0)] {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4cba03-0095-4ced-bde8-4a9bb7f736d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66c945b-bf1d-4d23-8ad2-fccf6490d6f7]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)
Aug 17 20:23:51 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf (non-flash)
Aug 17 20:23:51 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3994456c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf'): ({'sdb'}, set())}) {{(pid=72815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Removing single pathed devices sdb {{(pid=72815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[383a6617-64fb-425f-9486-0ce8e488d46c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cde276-6bd4-41d4-8462-70c96a60183b]: (4, ('ok\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Flushing IO for device /dev/sdb {{(pid=72815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1e063e-f98d-40d5-a2aa-3372bb1c40e7]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c1865f-2563-45df-83fd-18fe6223292f]: (4, ('1', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.linuxscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] SCSI volumes sdb have been removed. {{(pid=72815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf')] {{(pid=72815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1dae8c-15d6-4580-b0b3-4639d5127280]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --logout {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[004fb25f-4bd4-4099-afe9-0c6f4f149b6b]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf, portal: 172.16.0.220,3260]
Aug 17 20:23:51 user nova-compute[72815]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf, portal: 172.16.0.220,3260] successful.
Aug 17 20:23:51 user nova-compute[72815]:  stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op delete {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d2c7d0-c8e7-4628-bbb0-bb099d12dedf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84269) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db59878-e610-4892-80a9-bb04b8380a33]: (4, ('', '')) {{(pid=84269) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.base [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG os_brick.initiator.connectors.iscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] <== disconnect_volume: return (290ms) None {{(pid=72815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 20:23:51 user nova-compute[72815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Disconnected iSCSI Volume {{(pid=72815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 20:23:52 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:52 user nova-compute[72815]: DEBUG nova.objects.instance [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'flavor' on Instance uuid 20a2c899-49ce-4118-be88-4be69dc205fb {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:23:52 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-544dbea7-90e0-47c2-8868-b66b5477c832 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.764s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:23:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:23:54 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:23:54 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:23:54 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:23:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:23:56 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:23:57 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:23:59 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:24:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:24:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:24:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:24:04 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:24:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:24:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:24:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:24:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:24:14 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:18 user nova-compute[72815]: INFO nova.compute.manager [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Terminating instance
Aug 17 20:24:18 user nova-compute[72815]: DEBUG nova.compute.manager [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-bcf610d0-ff15-4ec1-a20a-be9912ad133e req-219d4bca-66ca-4cd8-9c22-ebb503dece0e service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Received event network-vif-unplugged-b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bcf610d0-ff15-4ec1-a20a-be9912ad133e req-219d4bca-66ca-4cd8-9c22-ebb503dece0e service nova] Acquiring lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bcf610d0-ff15-4ec1-a20a-be9912ad133e req-219d4bca-66ca-4cd8-9c22-ebb503dece0e service nova] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-bcf610d0-ff15-4ec1-a20a-be9912ad133e req-219d4bca-66ca-4cd8-9c22-ebb503dece0e service nova] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-bcf610d0-ff15-4ec1-a20a-be9912ad133e req-219d4bca-66ca-4cd8-9c22-ebb503dece0e service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] No waiting events found dispatching network-vif-unplugged-b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:24:18 user nova-compute[72815]: DEBUG nova.compute.manager [req-bcf610d0-ff15-4ec1-a20a-be9912ad133e req-219d4bca-66ca-4cd8-9c22-ebb503dece0e service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Received event network-vif-unplugged-b3771f5f-ac74-4ab4-9631-9eab589f24ae for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:24:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:19 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Instance destroyed successfully.
Aug 17 20:24:19 user nova-compute[72815]: DEBUG nova.objects.instance [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lazy-loading 'resources' on Instance uuid 35d7e1a6-06e2-48e8-babb-af7b31d50d77 {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:24:19 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1516825561',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1516825561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1516825',id=51,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc9Gm74ZrcKoEilBAjz2zI+7e7xlS9Qnh4jkcsdjT8anTmidILXWAnEXQ85q9iJQ54521RJoDojPE1PWTELm86nZ72pLwbqLQoK9OveNgYKQfZKfN5VzZr5fn5oKNWnOQ==',key_name='tempest-keypair-1573598965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:21:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a584bbd9ac504db78dd5bf1f5ce8a1f2',ramdisk_id='',reservation_id='r-edtlrkcc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1412262998',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c31aa201164e58b631421aeb1df52e',uuid=35d7e1a6-06e2-48e8-babb-af7b31d50d77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "address": "fa:16:3e:b7:d0:cd", "network": {"id": "01c030f2-8e11-48aa-8b7c-bbf377486499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1379663334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a584bbd9ac504db78dd5bf1f5ce8a1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3771f5f-ac", "ovs_interfaceid": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:24:19 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Converting VIF {"id": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "address": "fa:16:3e:b7:d0:cd", "network": {"id": "01c030f2-8e11-48aa-8b7c-bbf377486499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1379663334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a584bbd9ac504db78dd5bf1f5ce8a1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3771f5f-ac", "ovs_interfaceid": "b3771f5f-ac74-4ab4-9631-9eab589f24ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:24:19 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=b3771f5f-ac74-4ab4-9631-9eab589f24ae,network=Network(01c030f2-8e11-48aa-8b7c-bbf377486499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3771f5f-ac') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:24:19 user nova-compute[72815]: DEBUG os_vif [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=b3771f5f-ac74-4ab4-9631-9eab589f24ae,network=Network(01c030f2-8e11-48aa-8b7c-bbf377486499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3771f5f-ac') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:24:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3771f5f-ac, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:24:19 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:24:19 user nova-compute[72815]: INFO os_vif [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=b3771f5f-ac74-4ab4-9631-9eab589f24ae,network=Network(01c030f2-8e11-48aa-8b7c-bbf377486499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3771f5f-ac')
Aug 17 20:24:19 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Deleting instance files /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77_del
Aug 17 20:24:19 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Deletion of /opt/stack/data/nova/instances/35d7e1a6-06e2-48e8-babb-af7b31d50d77_del complete
Aug 17 20:24:19 user nova-compute[72815]: INFO nova.compute.manager [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 17 20:24:19 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:24:19 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:24:19 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:24:20 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:24:20 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Took 0.92 seconds to deallocate network for instance.
Aug 17 20:24:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:20 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:24:20 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:24:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:20 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Deleted allocations for instance 35d7e1a6-06e2-48e8-babb-af7b31d50d77
Aug 17 20:24:20 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-caa7ed7b-e4f9-4c5e-9b1b-35aaa7133350 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998 tempest-TestServerVolumeAttachScenarioOldVersion-1412262998-project-member] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.277s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-94312623-5ff1-4bd1-b836-90b71107c760 req-819e79ef-bf5c-4a10-9580-c3085340495b service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Received event network-vif-plugged-b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:24:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-94312623-5ff1-4bd1-b836-90b71107c760 req-819e79ef-bf5c-4a10-9580-c3085340495b service nova] Acquiring lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-94312623-5ff1-4bd1-b836-90b71107c760 req-819e79ef-bf5c-4a10-9580-c3085340495b service nova] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:21 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-94312623-5ff1-4bd1-b836-90b71107c760 req-819e79ef-bf5c-4a10-9580-c3085340495b service nova] Lock "35d7e1a6-06e2-48e8-babb-af7b31d50d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-94312623-5ff1-4bd1-b836-90b71107c760 req-819e79ef-bf5c-4a10-9580-c3085340495b service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] No waiting events found dispatching network-vif-plugged-b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:24:21 user nova-compute[72815]: WARNING nova.compute.manager [req-94312623-5ff1-4bd1-b836-90b71107c760 req-819e79ef-bf5c-4a10-9580-c3085340495b service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Received unexpected event network-vif-plugged-b3771f5f-ac74-4ab4-9631-9eab589f24ae for instance with vm_state deleted and task_state None.
Aug 17 20:24:21 user nova-compute[72815]: DEBUG nova.compute.manager [req-94312623-5ff1-4bd1-b836-90b71107c760 req-819e79ef-bf5c-4a10-9580-c3085340495b service nova] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Received event network-vif-deleted-b3771f5f-ac74-4ab4-9631-9eab589f24ae {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:24:24 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "9b074879-428b-4442-b322-f4fdfce4708f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "9b074879-428b-4442-b322-f4fdfce4708f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "9b074879-428b-4442-b322-f4fdfce4708f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "9b074879-428b-4442-b322-f4fdfce4708f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:27 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "9b074879-428b-4442-b322-f4fdfce4708f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:27 user nova-compute[72815]: INFO nova.compute.manager [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Terminating instance
Aug 17 20:24:27 user nova-compute[72815]: DEBUG nova.compute.manager [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:24:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:27 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-dc5f1edd-0fd3-4753-980e-82a91f54c2ce req-95302fc1-17a0-4fdd-b522-2051dfd86d6f service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Received event network-vif-unplugged-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dc5f1edd-0fd3-4753-980e-82a91f54c2ce req-95302fc1-17a0-4fdd-b522-2051dfd86d6f service nova] Acquiring lock "9b074879-428b-4442-b322-f4fdfce4708f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dc5f1edd-0fd3-4753-980e-82a91f54c2ce req-95302fc1-17a0-4fdd-b522-2051dfd86d6f service nova] Lock "9b074879-428b-4442-b322-f4fdfce4708f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-dc5f1edd-0fd3-4753-980e-82a91f54c2ce req-95302fc1-17a0-4fdd-b522-2051dfd86d6f service nova] Lock "9b074879-428b-4442-b322-f4fdfce4708f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-dc5f1edd-0fd3-4753-980e-82a91f54c2ce req-95302fc1-17a0-4fdd-b522-2051dfd86d6f service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] No waiting events found dispatching network-vif-unplugged-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG nova.compute.manager [req-dc5f1edd-0fd3-4753-980e-82a91f54c2ce req-95302fc1-17a0-4fdd-b522-2051dfd86d6f service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Received event network-vif-unplugged-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:28 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Instance destroyed successfully.
Aug 17 20:24:28 user nova-compute[72815]: DEBUG nova.objects.instance [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lazy-loading 'resources' on Instance uuid 9b074879-428b-4442-b322-f4fdfce4708f {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:22:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-219282586',display_name='tempest-VolumesActionsTest-instance-219282586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-219282586',id=52,image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c884a816adc40bf9932e18058380156',ramdisk_id='',reservation_id='r-v6rc3ex8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03ea87a0-d39d-476c-ae9f-307cb35323b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-396564338',owner_user_name='tempest-VolumesActionsTest-396564338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:22:43Z,user_data=None,user_id='5d0912af2d65439f9f816c6aa00e9a56',uuid=9b074879-428b-4442-b322-f4fdfce4708f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "address": "fa:16:3e:9a:d2:8e", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba77d7e-33", "ovs_interfaceid": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Converting VIF {"id": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "address": "fa:16:3e:9a:d2:8e", "network": {"id": "a23046f7-b8d9-4504-ade6-b5e14fc3d745", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1847796864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c884a816adc40bf9932e18058380156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba77d7e-33", "ovs_interfaceid": "4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d2:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba77d7e-33') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG os_vif [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d2:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba77d7e-33') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ba77d7e-33, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:28 user nova-compute[72815]: INFO os_vif [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d2:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9,network=Network(a23046f7-b8d9-4504-ade6-b5e14fc3d745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba77d7e-33')
Aug 17 20:24:28 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Deleting instance files /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f_del
Aug 17 20:24:28 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Deletion of /opt/stack/data/nova/instances/9b074879-428b-4442-b322-f4fdfce4708f_del complete
Aug 17 20:24:28 user nova-compute[72815]: INFO nova.compute.manager [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 20:24:28 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:24:28 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Took 0.47 seconds to deallocate network for instance.
Aug 17 20:24:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:24:28 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:24:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:29 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Deleted allocations for instance 9b074879-428b-4442-b322-f4fdfce4708f
Aug 17 20:24:29 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-ac6665d1-a6c8-4fdd-9794-9d7dcd692b37 tempest-VolumesActionsTest-396564338 tempest-VolumesActionsTest-396564338-project-member] Lock "9b074879-428b-4442-b322-f4fdfce4708f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.618s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-48ce0c07-0ca7-4614-a451-d82b5e6e5f4e req-d6934fd7-4081-4919-ac73-a9f5f6ae093c service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Received event network-vif-plugged-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:24:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-48ce0c07-0ca7-4614-a451-d82b5e6e5f4e req-d6934fd7-4081-4919-ac73-a9f5f6ae093c service nova] Acquiring lock "9b074879-428b-4442-b322-f4fdfce4708f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-48ce0c07-0ca7-4614-a451-d82b5e6e5f4e req-d6934fd7-4081-4919-ac73-a9f5f6ae093c service nova] Lock "9b074879-428b-4442-b322-f4fdfce4708f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:30 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-48ce0c07-0ca7-4614-a451-d82b5e6e5f4e req-d6934fd7-4081-4919-ac73-a9f5f6ae093c service nova] Lock "9b074879-428b-4442-b322-f4fdfce4708f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-48ce0c07-0ca7-4614-a451-d82b5e6e5f4e req-d6934fd7-4081-4919-ac73-a9f5f6ae093c service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] No waiting events found dispatching network-vif-plugged-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:24:30 user nova-compute[72815]: WARNING nova.compute.manager [req-48ce0c07-0ca7-4614-a451-d82b5e6e5f4e req-d6934fd7-4081-4919-ac73-a9f5f6ae093c service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Received unexpected event network-vif-plugged-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 for instance with vm_state deleted and task_state None.
Aug 17 20:24:30 user nova-compute[72815]: DEBUG nova.compute.manager [req-48ce0c07-0ca7-4614-a451-d82b5e6e5f4e req-d6934fd7-4081-4919-ac73-a9f5f6ae093c service nova] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Received event network-vif-deleted-4ba77d7e-33ef-4cef-9fc0-d152ddf4c6f9 {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:24:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:34 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303859.3384063, 35d7e1a6-06e2-48e8-babb-af7b31d50d77 => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:24:34 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] VM Stopped (Lifecycle Event)
Aug 17 20:24:34 user nova-compute[72815]: DEBUG nova.compute.manager [None req-c1dfcef1-45bd-46ab-9e44-826a93be0731 None None] [instance: 35d7e1a6-06e2-48e8-babb-af7b31d50d77] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:24:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:24:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:24:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:24:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:24:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:43 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303868.2792115, 9b074879-428b-4442-b322-f4fdfce4708f => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:24:43 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] VM Stopped (Lifecycle Event)
Aug 17 20:24:43 user nova-compute[72815]: DEBUG nova.compute.manager [None req-782483d1-e381-4af3-a38b-cd106d03b301 None None] [instance: 9b074879-428b-4442-b322-f4fdfce4708f] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:24:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:24:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:24:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:24:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:24:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 20:24:44 user nova-compute[72815]: DEBUG oslo_concurrency.processutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 20:24:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:24:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:24:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=8639MB free_disk=25.308448791503906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:24:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:45 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Instance 20a2c899-49ce-4118-be88-4be69dc205fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 20:24:45 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:24:45 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:24:45 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:24:45 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:24:45 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:24:45 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:47 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:47 user nova-compute[72815]: INFO nova.compute.manager [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Terminating instance
Aug 17 20:24:48 user nova-compute[72815]: DEBUG nova.compute.manager [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Start destroying the instance on the hypervisor. {{(pid=72815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-f38dc65b-4929-4545-836a-770c3052c837 req-2753322c-16b1-404d-ae71-fb2da647ee2e service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-vif-unplugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f38dc65b-4929-4545-836a-770c3052c837 req-2753322c-16b1-404d-ae71-fb2da647ee2e service nova] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f38dc65b-4929-4545-836a-770c3052c837 req-2753322c-16b1-404d-ae71-fb2da647ee2e service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-f38dc65b-4929-4545-836a-770c3052c837 req-2753322c-16b1-404d-ae71-fb2da647ee2e service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-f38dc65b-4929-4545-836a-770c3052c837 req-2753322c-16b1-404d-ae71-fb2da647ee2e service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] No waiting events found dispatching network-vif-unplugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG nova.compute.manager [req-f38dc65b-4929-4545-836a-770c3052c837 req-2753322c-16b1-404d-ae71-fb2da647ee2e service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-vif-unplugged-6e92fa72-b9bc-4631-8620-2acce92bacab for instance with task_state deleting. {{(pid=72815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 20:24:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [-] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Instance destroyed successfully.
Aug 17 20:24:48 user nova-compute[72815]: DEBUG nova.objects.instance [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lazy-loading 'resources' on Instance uuid 20a2c899-49ce-4118-be88-4be69dc205fb {{(pid=72815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG nova.virt.libvirt.vif [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T20:19:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-332683521',display_name='tempest-TestMinimumBasicScenario-server-332683521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-332683521',id=48,image_ref='a2ccfdb8-e1b1-4f73-bba9-b134b6436c28',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIumA8PFaYLbKQ+bhy1YFjZoYOGUv+seEAbHpBQrIhRqcOXuJmndc98za0aw1IHGw5bovmLJwC12/Taj/+qE0bknA0xd7Li4Ybo4z9ldvQQrjKHFPRkfL5yLep1dfN5pxA==',key_name='tempest-TestMinimumBasicScenario-1186874166',keypairs=<?>,launch_index=0,launched_at=2023-08-17T20:19:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6adbeb02ec1e45b3b7c2af06e7cb92cf',ramdisk_id='',reservation_id='r-otyon7c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a2ccfdb8-e1b1-4f73-bba9-b134b6436c28',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1472868221',owner_user_name='tempest-TestMinimumBasicScenario-1472868221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T20:22:05Z,user_data=None,user_id='39ef6674029a4e51bfd614a9a834970c',uuid=20a2c899-49ce-4118-be88-4be69dc205fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converting VIF {"id": "6e92fa72-b9bc-4631-8620-2acce92bacab", "address": "fa:16:3e:92:d7:ac", "network": {"id": "ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1733849478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6adbeb02ec1e45b3b7c2af06e7cb92cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e92fa72-b9", "ovs_interfaceid": "6e92fa72-b9bc-4631-8620-2acce92bacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG nova.network.os_vif_util [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=6e92fa72-b9bc-4631-8620-2acce92bacab,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e92fa72-b9') {{(pid=72815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG os_vif [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=6e92fa72-b9bc-4631-8620-2acce92bacab,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e92fa72-b9') {{(pid=72815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e92fa72-b9, bridge=br-int, if_exists=True) {{(pid=72815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:24:48 user nova-compute[72815]: INFO os_vif [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=6e92fa72-b9bc-4631-8620-2acce92bacab,network=Network(ea3e2855-08a9-4fd6-8db7-f4d24dd1a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e92fa72-b9')
Aug 17 20:24:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Deleting instance files /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb_del
Aug 17 20:24:48 user nova-compute[72815]: INFO nova.virt.libvirt.driver [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Deletion of /opt/stack/data/nova/instances/20a2c899-49ce-4118-be88-4be69dc205fb_del complete
Aug 17 20:24:48 user nova-compute[72815]: INFO nova.compute.manager [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 20:24:48 user nova-compute[72815]: DEBUG oslo.service.loopingcall [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG nova.compute.manager [-] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Deallocating network for instance {{(pid=72815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 20:24:48 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] deallocate_for_instance() {{(pid=72815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 20:24:49 user nova-compute[72815]: DEBUG nova.network.neutron [-] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Updating instance_info_cache with network_info: [] {{(pid=72815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 20:24:49 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Took 0.89 seconds to deallocate network for instance.
Aug 17 20:24:49 user nova-compute[72815]: DEBUG nova.compute.manager [req-ec00c2f2-a3ec-4f30-bc53-46ce6cb02bb4 req-b3d278a2-1ffa-4d6b-84c3-b9c91ff9115a service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-vif-deleted-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:24:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:49 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:49 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Refreshing inventories for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 20:24:49 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Updating ProviderTree inventory for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 20:24:49 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Updating inventory in ProviderTree for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 20:24:49 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Refreshing aggregate associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, aggregates: None {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 20:24:49 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Refreshing trait associations for resource provider d6bf6002-de69-45c8-b950-cf2491d2cb73, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=72815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 20:24:50 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:24:50 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:24:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:50 user nova-compute[72815]: INFO nova.scheduler.client.report [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Deleted allocations for instance 20a2c899-49ce-4118-be88-4be69dc205fb
Aug 17 20:24:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-dcacf91f-9b7f-4352-920c-69fd88c67003 tempest-TestMinimumBasicScenario-1472868221 tempest-TestMinimumBasicScenario-1472868221-project-member] Lock "20a2c899-49ce-4118-be88-4be69dc205fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.211s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-666a6bcf-1719-404f-96b0-68e32f170754 req-7c80fc8d-6d0e-4dd4-b3ca-0057e0c79209 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received event network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 20:24:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-666a6bcf-1719-404f-96b0-68e32f170754 req-7c80fc8d-6d0e-4dd4-b3ca-0057e0c79209 service nova] Acquiring lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:24:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-666a6bcf-1719-404f-96b0-68e32f170754 req-7c80fc8d-6d0e-4dd4-b3ca-0057e0c79209 service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:24:50 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [req-666a6bcf-1719-404f-96b0-68e32f170754 req-7c80fc8d-6d0e-4dd4-b3ca-0057e0c79209 service nova] Lock "20a2c899-49ce-4118-be88-4be69dc205fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:24:50 user nova-compute[72815]: DEBUG nova.compute.manager [req-666a6bcf-1719-404f-96b0-68e32f170754 req-7c80fc8d-6d0e-4dd4-b3ca-0057e0c79209 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] No waiting events found dispatching network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab {{(pid=72815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 20:24:50 user nova-compute[72815]: WARNING nova.compute.manager [req-666a6bcf-1719-404f-96b0-68e32f170754 req-7c80fc8d-6d0e-4dd4-b3ca-0057e0c79209 service nova] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Received unexpected event network-vif-plugged-6e92fa72-b9bc-4631-8620-2acce92bacab for instance with vm_state deleted and task_state None.
Aug 17 20:24:51 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:24:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:24:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 20:24:51 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:24:51 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:24:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:24:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:24:54 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:24:55 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:24:56 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:24:56 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:24:57 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:24:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:24:58 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:24:59 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:24:59 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 20:25:03 user nova-compute[72815]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692303888.772066, 20a2c899-49ce-4118-be88-4be69dc205fb => Stopped> {{(pid=72815) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 20:25:03 user nova-compute[72815]: INFO nova.compute.manager [-] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] VM Stopped (Lifecycle Event)
Aug 17 20:25:03 user nova-compute[72815]: DEBUG nova.compute.manager [None req-bf9ee280-8c03-4320-b6ba-17571aeb4c86 None None] [instance: 20a2c899-49ce-4118-be88-4be69dc205fb] Checking state {{(pid=72815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 20:25:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:25:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:25:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:25:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:25:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:09 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:12 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:15 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:17 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:25:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 20:25:17 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] There are 0 instances to clean {{(pid=72815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 20:25:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:25:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:25:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:25:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:25:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:25:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:25:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:25:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:25:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:25:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:25:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:25:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:25:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:25:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:25:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:25:44 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:25:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:25:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=24.643798828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:25:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:25:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:25:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:25:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:25:44 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:25:44 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:25:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:25:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:25:46 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:25:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:25:50 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:25:50 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:25:50 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 20:25:50 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 20:25:50 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:25:50 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:25:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:25:55 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:25:56 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:25:56 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:25:56 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:25:57 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:25:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:26:00 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:26:00 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:26:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:26:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:26:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:26:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:26:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:26:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:26:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:26:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:26:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:26:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:26:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:26:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:26:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:26:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:26:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:26:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:26:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:26:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:26:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:26:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:26:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:26:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=8907MB free_disk=25.372665405273438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:26:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:26:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:26:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:26:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:26:44 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:26:44 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:26:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:26:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:26:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:26:51 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:26:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:26:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 20:26:51 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 20:26:51 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:26:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:26:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:26:57 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:26:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:26:58 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:26:58 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:26:58 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:26:59 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:27:00 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:27:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:27:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:27:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:27:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:27:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:27:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:27:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:27:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:27:41 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:27:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:27:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:27:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:27:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:27:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:27:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:27:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:27:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:27:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=25.363292694091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:27:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:27:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:27:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:27:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:27:44 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:27:44 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:27:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:27:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:27:48 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:27:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:27:50 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:27:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:27:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:27:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 20:27:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 20:27:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:27:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:27:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:27:58 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:27:58 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:27:58 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:27:59 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:28:00 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:28:02 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:28:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:28:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:28:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:28:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:28:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:28:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:28:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:28:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:28:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:28:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:28:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:28:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:28:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:28:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:28:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:28:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:28:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:28:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:28:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:28:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:28:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:28:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=25.36197280883789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:28:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:28:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:28:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:28:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:28:44 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:28:44 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:28:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:28:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:28:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:28:51 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:28:52 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:28:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:28:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 20:28:52 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 20:28:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:28:54 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:28:58 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:28:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:28:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:28:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:28:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:28:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:28:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:29:00 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:29:00 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:29:00 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:29:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:29:03 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:29:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:29:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:29:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:29:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:29:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:29:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:29:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:29:13 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:29:16 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:29:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:29:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:29:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:29:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:29:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:29:16 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:29:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Verify base images {{(pid=72815) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 17 20:29:16 user nova-compute[72815]: WARNING nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28
Aug 17 20:29:16 user nova-compute[72815]: WARNING nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5
Aug 17 20:29:16 user nova-compute[72815]: WARNING nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267
Aug 17 20:29:16 user nova-compute[72815]: WARNING nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea
Aug 17 20:29:16 user nova-compute[72815]: WARNING nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb
Aug 17 20:29:16 user nova-compute[72815]: WARNING nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Unknown base file: /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff
Aug 17 20:29:16 user nova-compute[72815]: WARNING nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Unknown base file: /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f
Aug 17 20:29:16 user nova-compute[72815]: WARNING nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2
Aug 17 20:29:16 user nova-compute[72815]: WARNING nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Unknown base file: /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd
Aug 17 20:29:16 user nova-compute[72815]: WARNING nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79
Aug 17 20:29:16 user nova-compute[72815]: INFO nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Removable base files: /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28 /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5 /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267 /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2 /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79
Aug 17 20:29:16 user nova-compute[72815]: INFO nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4e458e1db3c643f9955cf1d7cbf0c90131c96a28
Aug 17 20:29:16 user nova-compute[72815]: INFO nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e44fa659745b75852b691d0558322864a47aa0d5
Aug 17 20:29:16 user nova-compute[72815]: INFO nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c81b47fb2bb00d6cf80426b18fbba864bc0ee267
Aug 17 20:29:16 user nova-compute[72815]: INFO nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0af8a97a7153b827c926f3483d668713830295ea
Aug 17 20:29:16 user nova-compute[72815]: INFO nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e4ef065608bba0280f64bd92cf9909097f73a8eb
Aug 17 20:29:16 user nova-compute[72815]: INFO nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/43e1548167728acd8c409a75c9486f5479d0cfff
Aug 17 20:29:16 user nova-compute[72815]: INFO nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/89c0a6e768dc636c424275cca3f3674e9bcbd38f
Aug 17 20:29:16 user nova-compute[72815]: INFO nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fbacebbbc1a4e2d48573abaf9eadf705bf7dd8a2
Aug 17 20:29:16 user nova-compute[72815]: INFO nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/287ac792923b8163b8ca571f6462a7a74e9ad3dd
Aug 17 20:29:16 user nova-compute[72815]: INFO nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ea5016ba036bca475b022a43b98f716a30d5cf79
Aug 17 20:29:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Verification complete {{(pid=72815) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 17 20:29:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Verify swap images {{(pid=72815) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 17 20:29:16 user nova-compute[72815]: DEBUG nova.virt.libvirt.imagecache [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Verify ephemeral images {{(pid=72815) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 17 20:29:18 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:29:23 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:29:28 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:29:33 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:29:38 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:29:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:29:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:29:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 20:29:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:29:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 20:29:43 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:29:43 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:29:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:29:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:29:43 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:29:43 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Auditing locally available compute resources for user (node: user) {{(pid=72815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 20:29:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:29:44 user nova-compute[72815]: WARNING nova.virt.libvirt.driver [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 20:29:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Hypervisor/Node resource view: name=user free_ram=8933MB free_disk=25.36064910888672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 20:29:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 20:29:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 20:29:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 20:29:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 20:29:44 user nova-compute[72815]: DEBUG nova.compute.provider_tree [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed in ProviderTree for provider: d6bf6002-de69-45c8-b950-cf2491d2cb73 {{(pid=72815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 20:29:44 user nova-compute[72815]: DEBUG nova.scheduler.client.report [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Inventory has not changed for provider d6bf6002-de69-45c8-b950-cf2491d2cb73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 20:29:44 user nova-compute[72815]: DEBUG nova.compute.resource_tracker [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Compute_service record updated for user:user {{(pid=72815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 20:29:44 user nova-compute[72815]: DEBUG oslo_concurrency.lockutils [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=72815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 20:29:48 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:29:50 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:29:50 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:29:50 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:29:53 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:29:54 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:29:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Starting heal instance info cache {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 20:29:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Rebuilding the list of instances to heal {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 20:29:54 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Didn't find any instances for network info cache update. {{(pid=72815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 20:29:55 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:29:57 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:29:58 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 20:30:00 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:30:00 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:30:00 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:30:00 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 20:30:02 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:30:03 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 20:30:04 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:30:06 user nova-compute[72815]: DEBUG oslo_service.periodic_task [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 20:30:06 user nova-compute[72815]: DEBUG nova.compute.manager [None req-eb47768f-05ae-4b28-adb1-a5b542b6b146 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 20:30:08 user nova-compute[72815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}